BoM to overhaul data extraction software system

The system will aid the agency's expanding water information system

The Bureau of Meteorology (BoM) has flagged plans to overhaul its data extraction software system to aid its expanding water information program.

The agency is seeking an extract, transform and load (ETL) software system, to replace previous personalised systems, in order to extract water-related data in a range of formats from an increasing number of sources.

“The need to have consistent and efficient means by which to process and ingest this data obtained from a wide range of sources has grown substantially over the last few years and is expected to expand yet further over coming years,” agency documents read.

“To date the Bureau has implemented several bespoke applications to undertake these operations, whereas there is now a desire to move towards the use of non-bespoke approaches where it makes good economic sense to do so.

According to agency documents, the system will enable developers to create processes to automatically input data from a range of data sources and formats, perform specified operations and transformations on these data, and feed the data into a data warehouse.

The system will also have suitable management interfaces for processes, provide the means to deploy and execute these processes centrally, and operate on software platforms currently supported by the BoM.

The agency anticipates the contract to be completed by 30 June 2012.

The bureau recently outlined plans to invest in a new integration framework to cope with the expanded number of sources producing spatial data.

The solution will assist with the processing of geospatial and related non-geospatial to support business and system processes.

Follow Chloe Herrick on Twitter: @chloe_CW

Follow Computerworld Australia on Twitter: @ComputerworldAU