Monday, February 17, 2020

Met Office forecasters set for 'billion pound' supercomputer

The Met Office's existing supercomputer

From BBC by David Shukman 

Ever wondered why your village was suddenly flooded by a thunderstorm the weather forecasters hadn't mentioned?

Or why they failed to warn you about the dense fog shrouding your home in the morning?

The fact is that predicting the "big picture" of future conditions has got a lot better - Storm Dennis was spotted six days before it arrived.
But getting local forecasts right - street by street and hour by hour - is still a massive challenge.
And that might now change as the Met Office secures the help of a supercomputer project costing £1.2bn.

Better forecasting means handling more data, more rapidly, and running it through simulations of the atmosphere more accurately.
Already the Met Office is pulling in more than 200 billion observations from satellites, weather stations and buoys out in the ocean every single day, and that's set to increase.
And working out if a summer downpour will flood your home or one down the road requires more and more processing power.
"We'll be streets ahead of anybody else," according to Penny Endersby, chief executive of the Met Office.
"Ultimately it'll make a difference to every individual, every government department, every industry as people see forecasts becoming steadily better."

It'll be the biggest investment in the 170-year history of the organisation and will dwarf the £97m bill for the current supercomputer.
In the new project, the billion-plus cost will cover not just the hardware itself but all the running costs too over a ten-year period.
There'll be a first stage installation, which should be six times more capable than the supercomputer used now.

And then five years later there'll be a major upgrade to increase performance by a further three times.

The new supercomputer will be six times more capable than the current one

What will the supercomputer actually do?

It'll run what the Met Office calls its "digital twin" of the Earth's atmosphere, a highly detailed "model" of everything from the winds to the temperatures to the pressures.
To create this simulated picture of our weather, the globe is divided into grid squares.

These have become smaller as the technology has advanced - and the smaller the better because that means more accuracy.

At the moment, the model of Earth is divided up into a grid of squares that are 10km across.
The UK gets more detailed treatment: its squares are 1,500m across.
London is studied with the aid of even smaller squares - 300m wide - mainly to improve the accuracy of forecasts for the airspace above the big airports.
And the ambition, when the new supercomputer is up and running, is to operate at an even sharper resolution, down to a scale of 100m.

Original supercomputer installed at the Met Office in Dunstable in 1959

Will it really make a difference?

The Met Office certainly believes it will.
There's huge demand for better forecasting - from the military to the power companies to organisers of big outdoor events.

It could guide Environment Agency teams deploying mobile flood barriers or help the National Grid balancing fluctuations in wind and solar power.

And the prospect of rising global temperatures fuelling new and more dangerous extremes of weather makes accuracy all the more important.

There has been a huge improvement in recent years - every passing decade has seen forecasts reach a whole day further into the future.
A five-day forecast now is as accurate as a one-day forecast 40 years ago.

So will the new computing power continue that advance?
Penny Endersby prefers not to be make any promises.
"I won't hang my hat on getting another day in the next decade," she says.
"But it will make our forecasts more accurate, more timely and more localised."

And the government has calculated what that could mean in hard cash: that for every pound invested, there should be £19 in economic benefit.

Time lapse footage of our Cray supercomputer being installed in our new IT Hall 3.

And will it help with climate change?

That's the aim, with the digitally-simulated atmosphere also run far into the future to explore the effects of a hotter world.

The effects of the rise of 1C over the past 150 years are still not fully understood, let alone those of bigger increases to come.
It should mean researchers can add more detail to their projections, weaving in factors such as the way nitrogen reacts with the carbon in the air.

And as the UK moves towards its target of net zero emissions by 2050, there'll be a chance to explore different options for how the country uses the land.
For example, what will the effects be of planting new forests or protecting peat bogs or growing more biofuels?


Won't the new supercomputer itself add to carbon emissions?

Like any huge IT installation, it'll certainly need a massive supply of electricity.
That's why the Met Office is inviting the potential providers to come up with low-carbon options.
And that's led to a radical idea.

The last 14 Met Office computers have all been housed in the UK - and the new one might not be.
Around half of the processing work - the research devoted to climate change - could be located in countries blessed with easy sources of clean energy.
Iceland with its geothermal sources and Norway with its hydropower are both possibilities.

The offer is only open to countries in the European Economic Area - locating the facility on another continent has been ruled out because of the time lag in using a distant connection.
Invitations to the IT industry to bid for the project are being drawn up and will go out near the end of the year.
And the start date for the new machine will be sometime in late 2022.

Links :

Saturday, February 15, 2020

Historic bomb cyclone swirls in North Atlantic, will hit Iceland and sideswipe U.K. as Storm Dennis

Satellite view of an intensifying North Atlantic bomb cyclone,
named Storm Dennis by the U.K. Met Office, as of Thursday morning.
(NASA Worldview)

From The WashingtonPost by Andrew Freedman with contribution of Matthew Cappucci

Storm could rival the most powerful nontropical lows recorded in this region.


 NOAA GFS forecast with Weather 4D R&N

A massive storm is rapidly intensifying in the North Atlantic, and Mother Nature is pushing her limits with it coming within striking distance of the strongest storm on record in that tempestuous part of the world.

 Phenomenal seas forecast from Storm Dennis with waves over 16-18 meters forecast

Seen via satellite, the storm, which the U.K. Met Office is referring to as Storm Dennis since it will sideswipe that region over the weekend, resembles a giant comma drawn across a vast area of real estate.
Its clouds stretch from south of Iceland all the way into the Caribbean.
At its peak, the storm may extend for 5,000 miles, with a cold front’s tentacles extending from near Florida all the way near the center of the beastly storm northwest of Scotland.
As of midday, the storm was still strengthening, undergoing a rapid intensification process known as bombogenesis.
Computer models show a rare scenario playing out, with the storm maxing out at an intensity of 915 millibars, which would be just 2 millibars shy of the all-time North Atlantic record, set by the Braer Storm of 1993.
In general, the lower the air pressure, the stronger the storm.

Such an air pressure reading would be more than five standard deviations from the norm, and would place the storm in the top 10 list of the strongest North Atlantic nontropical storms on record.

The weather system is being aided by a powerhouse jet stream that is roaring across the North Atlantic, and may peak at around 240 mph by Friday or Saturday.
This could cause some transatlantic flights to challenge the record flight time set just last weekend by a British Airways 747-400, which flew the route from New York’s Kennedy Airport to London Heathrow in just 4 hours and 46 minutes.

The jet stream — a highway of air around 30,000 feet above the surface that helps steer storm systems — is the result of strong air pressure differences between Arctic low pressure and high pressure areas to the south.
It is helping to invigorate storm systems as they move off the coast of the United States and into the North Atlantic.

According to the National Weather Service’s Ocean Prediction Center, the storm’s minimum central air pressure had plunged to 940 millibars as of 8 a.m. Eastern time.
A satellite with a sensor that can detect wave heights and wind speeds at the Earth’s surface passed over the storm Thursday morning and found significant wave heights of up to 51 feet.
Since that metric is defined as the average of the highest one-third of waves in a particular period, this indicates that individual waves may be about twice as tall, up to a staggering and ship-sinking 100 feet.

 Rapidly intensifying storm over the North Atlantic on Thursday.
(RAMMB/CIRA)

The OPC’s forecast for the storm calls for it to pack sustained winds of up to 100 mph, along with “phenomenal seas” when it reaches peak intensity sometime between Friday and Saturday.

To qualify as a bomb cyclone, a nontropical storm needs to intensify by at least 24 millibars in 24 hours.
This particular low pressure area saw its pressure plummet at nearly twice that rate, deepening by 46 millibars in 24 hours, with further rapid intensification in the forecast.
Over a longer time period, the storm’s minimum pressure has dropped by 65 millibars in 36 hours.

 Strong winds will batter several countries before heavy rain hits this week-end.
Credit : Owen Humphreys / PA

European impacts

In the U.K., which just experienced deadly impacts from Storm Ciara, weather forecasters have issued amber warnings for heavy rain from Storm Dennis, noting the potential for several inches of rain to fall, along with damaging winds. Flood warnings are already in effect, given the one-two punch from Ciara.

Winds are forecast to gust past 50 to 60 mph in many areas this weekend, the Met Office said. Fortunately, the center of the storm is forecast to remain far enough to the northwest to spare even Scotland from the strongest winds, though gusts at hurricane force (74 mph) are likely there. Pounding surf and possible coastal flooding is also possible, given the huge swells generated by this weather system.
The storm’s impacts will also sweep into other parts of northwest Europe, including Denmark, Germany and Norway.

Iceland will be closer to the northern core of this storm as well as another intense low pressure area that’s already swirling around the North Atlantic near Greenland, with the most severe impacts hitting Friday into Friday night.

Storm Dennis is actually going to merge with that other storm after doing a unique meteorological dance, known as the Fujiwhara Effect, and the impacts of this interaction could be severe in Iceland.
That country’s weather agency issued orange and red alerts for sustained winds of greater than hurricane force and whiteout conditions in some locations, calling for heavy snow and sleet to fall across the entire country, with the greatest accumulations in mountain areas.

Downtown Reykjavik could see sustained winds in excess of 70 mph, the Icelandic Meteorological Office warned.
A forecast note issued Thursday warns of “violent easterly winds” through Friday in southern parts of Iceland, for example.
The aviation forecast for Keflavik International Airport calls for sustained winds of 71 mph with gusts to 92 mph Friday, which would be strong enough to halt all flights.


An unusual winter

This is the peak time of year for bomb cyclones in the North Atlantic, given the typical intensity of the jet stream and intense air mass differences that tend to move out over moisture-rich waters. What’s been especially noteworthy about the winter’s weather, however, is the frequency and intensity of the storms spawned in the North Atlantic.

It’s a 921mb inbound.
That’s worse than Ciara storm.

Very few of these storms typically see their minimum central air pressure drop to 930 millibars or lower; yet assuming Storm Dennis does so, this will have happened twice in the past 10 days.
The storm east of Greenland, which helped propel Ciara into Europe, over the weekend accomplished this feat as well.

The strong near-zonal — or straight west-to-east — jet stream is characteristic of periods when a weather pattern above the North Atlantic, known as the Arctic Oscillation (AO), is in a what is known as a positive state, with low pressure predominating near Greenland and a ridge of high pressure in the northeastern Atlantic.
On Monday, the AO set a daily record for its most positive reading since such record-keeping began.

The AO is one of the main reasons winter has been absent in much of the eastern U.S. and parts of Europe, and it’s helping to turn the North Atlantic into a virtual bomb cyclone express lane.

In addition to the deaths and damage from Ciara, the winter’s North Atlantic storms have also affected the North America.
Last month, for example, Newfoundland and Labrador were buried by one of their worst blizzards on record when a storm underwent rapid intensification and piled snow up to the second to third stories of buildings in downtown St. John’s.

This storm isn't going to stop us from having a great weekend... ;-)

Links :

Friday, February 14, 2020

High-Resolution Sea Surface Temperature data available in the Cloud

Multi-Scale Ultra High Resolution (MUR) 1km Sea Surface Temperature (SST) data
from June 2002 to present are available in the cloud.

From NASA by Emily Cassidy

High-resolution sea surface temperature data can be used to study marine heat waves and the health of marine ecosystems.

New high-resolution sea surface temperature data are now available in the cloud, as part of the NASA—Amazon Web Services (AWS) Space Act Agreement, executed by the Interagency Implementation and Advanced Concepts Team (IMPACT) for NASA's Earth Science Data Systems (ESDS) Program.
This development provides researchers with easy access to some of the highest resolution ocean temperature data available, which are optimized for cloud computing.

“It feels like this is an inflection point where computers go from being a tool for science to an enabler of science,” said Dr. Chelle Gentemann, senior scientist at Farallon Institute, who spearheaded the effort to move the data with the help of NASA's Physical Oceanography Distributed Active Archive Center (PO.DAAC).

Multi-Scale Ultra High Resolution Sea Surface Temperature (MUR SST) data are available from June 2002 to present at 1 km spatial resolution.
Making these data freely available in the cloud is part of a larger effort by ESDS to enable researchers and commercial data users to access and work with large quantities of data quickly.
These MUR SST data are optimized so that researchers can do large-scale analyses in the cloud.

“Something that took me three months and 3000 lines of code now takes me 10 minutes with 20 lines of code. Now you don't have to have a big supercomputer and a system administrator to figure out how to download, store, and access the data,” Gentemann said.
“This is a transformative technology that's paving the way for the democratization of science.”

High-resolution SST data can be used to study how climate is affecting marine ecosystems and contributing to more marine heat waves.
Marine heat waves can create toxic algae blooms that can disrupt marine ecosystems and threaten marine mammals and fisheries.
Dr. Gentemann has been using these data to see how marine heatwaves affected the U.S. West Coast.

MUR SST data reflect the truly international, multi-agency collaborations that are occurring as a result of NASA's open data policies.
They are produced by merging data from multiple sensors: NASA's Advanced Microwave Scanning Radiometer-EOS (AMSR-E), Japan Aerospace Exploration Agency's Advanced Microwave Scanning Radiometer 2 on GCOM-W1, the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA's Aqua and Terra satellites, the U.S. Navy's microwave WindSat radiometer, the Advanced Very High Resolution Radiometer (AVHRR) on several NOAA and European Space Agency satellites, and in-situ SST observations from the NOAA iQuam project.

Tutorials have been provided for accessing the MUR SST data using Python on the Registry of Open Data on AWS.
You can also view the data on PO.DAAC's State of the Ocean tool.
The MUR SST data were optimized for the cloud using computing credits provided by AWS Cloud Credits for Research Program and is available via the AWS Public Dataset Program.

More Information

Valentine Day


Galesnjak, Croatia, a heart-shaped island in Croatia,
Pléiades

 Galesnjak island with the GeoGarage platform (HHI ENC)

 Radar image of Galesnjak
taken with an ICEYE SAR satellite on February 8, 2020.
Have a lovely February 14!