Aquastat data

From Pardee Wiki
Jump to navigation Jump to search

Back to water preprocessor 

Most of the data used in the water preprocessor comes from the AQUASTAT database. http://www.fao.org/nr/water/aquastat/main/index.stm

Current status

Needs to be pulled. Link to task on teamwork: https://pardeecenter.teamwork.com/tasks/3797325


Series pulled from Aquastat

Table
Group Definition Years Source Last IFs Update UsedInPreprocessor
SeriesWaterWith%Household Environment, Infrastructure, Water Water withdrawals, percent used by households (1990=70-99;2000=update, mostly 2000) 1965, 1970, 1975, 1979-1980, 1982, 1984-1997, 1999-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWith%Ind Environment, Infrastructure, Water Water withdrawals, percent used in industry (1990=70-99;2000=update, mostly 2000) 1965, 1970, 1975, 1979-1980, 1982, 1984-1997, 1999-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrEquip%WaterManaged Agriculture, Infrastructure, Water % of agricultural water managed area equipped for irrigation (%)
1962, 1964-1967, 1970, 1972, 1974-1975, 1977, 1979-1980, 1982-1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterGroundEntering Infrastructure, Water, Health Groundwater entering the country (natural) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterTotalWithdPC Environment, Infrastructure, Water Total water withdrawal per capita 1962, 1965, 1970, 1975-1976, 1979-1980, 1982, 1984-1997, 1999-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWith%Fresh Agriculture, Infrastructure, Environment, Water % of total actual renewable freshwater resources withdrawn (%)
1962, 1965, 1970, 1975-1976, 1979-1980, 1982, 1984-1987, 1990-1997, 1999-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterDesalinated Environment, Infrastructure, Water Desalinated Water Produced 1988-1997, 1999-2008, 2010 AQUASTAT 2011/01/20 No
SeriesWaterGroundWithD Environment, Infrastructure, Water Ground Water Withdrawal 1980, 1985, 1987-1990, 1992-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterSurfaceWithD Environment, Infrastructure, Water Surface Water Withdrawal 1980, 1985, 1987-1990, 1992-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrEquip%Cultivated Agriculture, Infrastructure % of cultivated area equipped for irrigation (%)
1962, 1964-1967, 1970, 1972, 1974-1975, 1977, 1979-1980, 1982-1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrEquip%Potential Agriculture, Infrastructure % of irrigation potential equipped for irrigation (%)
1962, 1967, 1970, 1972, 1975, 1977, 1979-1980, 1982-1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrEquipActual Agriculture, Infrastructure Area equipped for irrigation: actually irrigated (1000 ha)
1962, 1967, 1972, 1975, 1977, 1980, 1982-1983, 1985-2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrEquipDrained Agriculture, Infrastructure Area equipped for irrigation drained (1000 ha)
1985, 1987, 1990-2006, 2008-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrHarvest%Equip Economic, Infrastructure Harvested irrigated crop area as % of area equipped for full control irrigation (%)
1984, 1987, 1989-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrHarvest%FullControl Economic, Infrastructure Harvested irrigated crop area as % of full control irrigation area actually irrigated (%)
1962, 1967, 1972, 1977, 1982, 1987, 1989-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrPotential Agriculture, Infrastructure Irrigation potential (1000 ha)
1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2005, 2007-2008, 2011 AQU 2013 BATCH PULL 2013/07/18 Yes
SeriesLandIrAreaEquip Agriculture, Infrastructure Area equipped for irrigation: total (1000 ha)
1962, 1964-1967, 1970, 1972, 1974-1975, 1977, 1979-1980, 1982-1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrWaterLogged Agriculture, Infrastructure Area waterlogged by irrigation (1000 ha)
1990-1993, 1995, 1997-2000, 2002-2007 AQU 2013 BATCH PULL 2013/07/18 No
SeriesTotalDamCapacity Economic, Infrastructure Total dam capacity (km3)
1960, 1965, 1970, 1975, 1977, 1980, 1984-1985, 1989-1998, 2000-2008, 2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrHarvestedCropArea Agriculture, Infrastructure Total harvested irrigated crop area (1000 ha)
1961, 1966, 1971-1972, 1975-1977, 1980-1982, 1984-1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWasterwaterTreated Economic, Infrastructure Wastewater: treated volume (10^9 m3/yr)
1967, 1971, 1975, 1979-1980, 1982, 1985, 1987, 1989-2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWastewaterTreatedReused Economic, Infrastructure Treated wastewater reused (10^9 m3/yr)
1962, 1967, 1971-1972, 1975, 1977, 1982, 1985, 1987, 1989-1998, 2000-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterTotalWithdSector Agriculture, Infrastructure, Environment, Water Total water withdrawal (summed by sector) 1988-1997, 1999-2006 AQUASTAT 2010/02/20 No
SeriesWaterDependencyRatio Agriculture, Infrastructure, Environment, Water Dependency ratio, percentage of total renewable water resources originating outside of the country 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterResTotalExploit Agriculture, Infrastructure, Environment, Water Water resources: total exploitable 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997-1998, 2000-2003, 2005, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterTotalAgManagedArea Agriculture, Infrastructure, Environment, Water Total agricultural water managed area 1962, 1964-1967, 1970, 1972, 1974-1975, 1977, 1979-1980, 1982-1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterTotalRenewPC Agriculture, Infrastructure, Environment, Water Water resources: total renewable per capita (actual) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWithAgr%FreshAquastat Agriculture, Infrastructure, Environment, Water % of total actual renewable water resources withdrawn by agriculture (%)
1988-2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWithdAgriculture Agriculture, Infrastructure, Environment, Water Agricultural water withdrawal 1965, 1969-1970, 1974-1975, 1979-1980, 1982, 1984-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWithdIndustrial Environment, Infrastructure, Water Industrial water withdrawal 1965, 1970, 1974-1975, 1979-1980, 1982, 1984-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWithdMunicipal Environment, Infrastructure, Water Municipal water withdrawal 1965, 1970, 1974-1975, 1979-1980, 1982, 1984-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterGroundLeaving Infrastructure, Water, Health Groundwater leaving the country (naturally) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterGroundProdInternal Infrastructure, Water, Health Groundwater produced internally (natural) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterGroundTotal Infrastructure, Water, Health Groundwater total renewable 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrPotentialReached Agriculture, Infrastructure Irrigation potential (1000 ha) for countries that reached the potential already 2009 AQUASTAT, at http://www.fao.org/nr/water/aquastat/dbase/index.stm 2011/11/16 Yes
SeriesLandCultivatedArea Economic, Infrastructure Cultivated area (1000 ha)
1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIr%Grain Agriculture, Infrastructure % of total grain production irrigated (%)
1984, 1988-1995 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrActual%Equip Agriculture, Infrastructure Area equipped for irrigation: actually irrigated, % 1962, 1967, 1972, 1975, 1977, 1980-1982, 1985, 1987-2012 AQU 2013 BATCH PULL 2013/07/18 No
SeriesLandIrAreaSalinized Agriculture, Infrastructure Area salinized by irrigation (1000 ha)
1972, 1987-1995, 1997-2006, 2009-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWastewaterProduced Economic, Infrastructure Wastewater: produced volume (10^9 m3/yr)
1965, 1967, 1971, 1975, 1979-1980, 1982, 1985, 1987, 1989-2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterResTotalRenew Agriculture, Infrastructure, Environment, Water Water resources: total renewable (actual) 1962, 1967, 1972, 1977, 1982, 1987, 1992-2007, 2011 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterTotalWithdSources Agriculture, Infrastructure, Environment, Water Total water withdrawal (summed by sources) 1962, 1965, 1970, 1975-1976, 1979-1980, 1982, 1984-1997, 1999-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesWaterWith%Agric Agriculture, Infrastructure, Environment, Water Water withdrawals, percent used in agriculture (1990=70-99;2000=update, mostly 2000) 1965, 1970, 1975, 1979-1980, 1982, 1984-1997, 1999-2010 AQU 2013 BATCH PULL 2013/07/18 No
SeriesDesalinatedWater Environment, Infrastructure, Water Desalinated Water Produced 1962, 1965, 1970, 1975-1976, 1979-1980, 1982, 1984-1997, 1999-2010 AQUASTAT 2011/01/20 No
SeriesWaterTotalWithd Environment, Infrastructure, Water Total water withdrawal (summed by sector) 1962, 1965, 1970, 1975-1976, 1979-1980, 1982, 1984-1997, 1999-2010 AQUASTAT 2011/01/20 No
SeriesWaterResExploitGround Environment, Infrastructure, Water Exploitable: regular renewable groundwater (10^9 m3/yr) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2014 BATCH PULL 2014/02/19 No
SeriesWaterResExploitSurface Environment, Infrastructure, Water Exploitable: total renewable surface water (10^9 m3/yr) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2014 BATCH PULL 2014/02/23 No
SeriesWaterResOverlap Environment, Infrastructure, Water Overlap between surface and groundwater 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2014 BATCH PULL 2014/02/19 No
SeriesWaterResTotalRenewGround Environment, Infrastructure, Water Total renewable groundwater (actual) (10^9 m3/yr) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2014 BATCH PULL 2014/02/19 No
SeriesWaterResTotalRenewSurface Environment, Infrastructure, Water Total renewable suface water (actual) 1962, 1967, 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, 2011 AQU 2014 BATCH PULL 2014/02/19 No

AquaStat Documentation:

Metadata: 

Abstract for AquaStat database

The AQUASTAT database can be queried on-line and the query results can be downloaded in CSV (table or flat) format. The current database regroups data per 5-year period and shows for each variable the value for the most recent year during that period, if available. For example, if for the period 2003-2007 data are available for the year 2004 and for the year 2006, then the value for the year 2006 is shown. Also, for many variables no time series can be made available yet due to lack of sufficient data. 

Data for the variable [4313] "Area equipped for irrigation: total" is collected by and available in both AQUASTAT and FAOSTAT and harmonization between AQUASTAT and FAOSTAT takes place on a regular basis to ensure consistency between the two. The difference between the two is that AQUASTAT only enters data for the year given in the reference, while FAOSTAT fills all years from 1961 onwards by inter- and extrapolation from the common data-points. Thus, time series on this variable can be found under FAOSTAT land, choosing the last variable in "items": Total area equipped for irrigation. For other non-water related time-series on food and agriculture see the FAOSTAT home page.

Update Frequency

Varies by Main Database category and sub-category:

  1. Geography and population category: Every year (through FAOSTAT for land use and population and undernourishment, World Bank for GDP, UNDP for HDI and GII).
  2. Water resources category: These are long-term average annual values and therefore remain the same over the years. A comprehensive review had been undertaken in 2014.
  3. Water use category and Irrigation and drainage development category: For Africa, Southern and Central America & Caribbean, and Asia: between 1 and 10 years, depending on data availability which is checked at least every 5 years for each country, and with a thorough update (full dataset) every 10 years together with the country profile update. For Europe, Northern America, Australia and New Zealand: depends on data availability from Eurostat and OECD.
  4. Updates of data for some specific sub-categories are being done in collaboration with others, as and when data become available, such as: wastewater sub-category in collaboration with IWMI; conservation agriculture sub-category in collaboration with Conservation Agriculture expert groups; access to improved drinking water source sub-category data are provided by the WHO/UNICEF Joint Monitoring Programme for Water Supply and Sanitation.
  5. Some of the variables are updated during major review exercises (see the other datasets below).

AquaStat Questionnaires and Guidelines

AQUASTAT uses questionnaires and prepares guidelines with detailed definitions and instructions, implements projects to strengthen national capacities, and holds workshops to clarify some of the more complex data concepts. Survey information is as follows:

To reach the above objective, it has been decided to proceed as follows, with two surveys:

 Every 5-10 years: a detailed global survey to prepare/update country profiles and regional syntheses. This document refers to this survey, which is prepared on the basis of a detailed questionnaire filled in at country level by national and regional experts, under the supervision of FAO/NRL.

 Every year: a small global survey to ensure regular updating of the existing country profiles, of key changes at country level, especially on the area equipped for irrigation and on the institutional and policy aspects. It is done by concerned institutions, which are willing to participate, and is managed in the regional and central offices of FAO.

The 5-10 year survey aims at preparing national country profiles in a homogeneous way. It ensures participation of national experts, in charge of the information collection and report drafting at the country level, and validation by FAO experts. The experts are provided with:

 A detailed questionnaire to be completed for each country at national level (and sub-national level for some variables) on the basis of existing available information

 Detailed guidelines for preparing a country profile and gathering qualitative information

 Explanatory notes and definitions to ensure consistency in the use of concepts and words and facilitate computation

Units

Units of population:

1000 inhabitants

Units of area:

1 acre = 4 047 m2 = 0.4047 ha = 4.047 x 10-4 x 1000 ha

1 are = 100 m2 = 0.01 ha = 1 x 10-5 x 1000 ha

1 aliqueire = 24 200 m2 = 2.42 ha = 2.42 x 10-3 x 1000 ha

1 caballeria = 450 000 m2 = 45 ha = 4.5 x 10-2 x 1000 ha

1 deciatine = 10 900 m2 = 1.09 ha = 1.09 x 10-3 x 1000 ha

1 feddan = 4 200 m2 = 0.42 ha = 4.2 x 10-4 x 1000 ha

1 ha = 10 000 m2

1 koh = 9 900 m2 = 0.99 ha = 9.9 x 10-4 x 1000 ha

1 km2 = 1 000 000 m2 = 100 ha = 1 x 10-1 x 1000 ha

1 m2 = 0.0001 ha = 1 x 10-7 x 1000 ha

1 morgen = 8 560 m2 = 0.856 ha = 8.56 x 10-4 x 1000 ha

1 mu = 667 m2 = 0.0667 ha = 6.67 x 10-5 x 1000 ha

1 square inch = 0.00064546 m2 = 0.000000064516 ha = 6.4516 x 10-11 x 1000 ha

1 square foot = 144 square inches = 0.09290304 m 2 = 0.000009290304 ha = 9.290304 x 10-9 x 1000 ha

1 square yard = 0.84 m2 = 0.000084 ha = 8.4 x 10-8 x 1000 ha

1 square mile = 2 590 000 m2 = 259 ha = 2.59 x 10-1 x 1000 ha

Units of volume:

1 acre-foot = 1 234 m3 = 1.234 x 10-6 km3

1 cubic foot (ft3 ) = 0.02832 m 3 = 2.832 x 10-11 km3

1 cubic yard (yd3 ) = 0.7646 m 3 = 7.646 x 10-10 km3 1 dm3 =

1 liter = 0.001 m3 = 1 x 10-12 km3 1 hm3 =

1 million m3 = 1 000 000 m 3 = 106 m 3 = 1 x 10-3 km 3 1 km3 =

1 billion m3 = 1000 million m3 = 109 m 3 1 m3 = 10-9 km3

1 UK gallon = 4.546 dm3 = 0.004546 m3 = 4.546 x 10-12 km3 :

1 US gallon = 3.785 dm3 = 0.003785 m3 = 3.785 x 10-12 km3 [volume]/hour = 24 x [volume]/day = 8 760 x [volume]/year [volume]/day = 365 x [volume]/year Units of costs

Costs should be expressed in US$ (United States Dollars) in the questionnaire and country profiles. The conversion used to pass from the local currency to US$ should be the one that was valid in the year to which the value refers and should be indicated in the comments. 

Definitions:

Definitions for every series can be found in this document: http://www.fao.org/nr/water/aquastat/sets/aq-5yr-guide_eng.pdf 

DataDict

Variable: Names were not changed from previous years this data was pulled. New variables were assigned names that are consistent with variables of similar topics.

Table: These were not changed from previous years this data was pulled. New variables were assigned based on the variable title and consistency.

Groups: These were not changed from previous years this data was pulled. New variables were assigned groups based on consistency with variables of similar topics. New Irrigation series were given groups: Agriculture, Infrastructure, Water. 

Subgroups: These were not changed form previoys years this data was pulled. New Irrigation data was given the Subgroup: Irrigation.

Definitions and Units: This categories were not changed from previous years. New variables were given definitions based on the consise definitions provided in the AquaStat database. Units were also provided in the data base.

Years: Years for every series were changed to available data provided through the database. Years vary between different series. The aquastat database calculates years in 5 year incriments. This five year incriments go back to 1958. The most recent incriment is 2013-2017. In the datadict, these incrimental periods are not used. Instead, only actual data recorded for the earliest specific year to the last specific year is used.

Source: Source for all AquaStat series were given AQU BATCH PULL.

Original Source: The original source for all series is the AquaStat database.

Notes and Last IFs Update were updated accordingly.

Aggregation: Aggregations were not changed from pervious updates. New variables were assigned aggregations based on the type of variable and the Units used.

Disaggregation was consistently GDP.

Name in source is based on the name each variable was given in the AquaStat database.

Code in Source: All codes were changed to match the exact variable names present when downloading the data from the database. The downloaded names were different from the name in source.

Decimal places: This category was left blank in order to avoid rounding exact data.

Country Concordance: FAO countries were used.

Series Updated

DataDict
Variable
DesalinatedWater
IrrigatedCropIntensity
IrWaterReq
IrWaterWith
LandCultivatedArea
LandEquipIrActual
LandEquipIrFullControl
LandEquipIrFullControlActual
LandIr%Grain
LandIrAreaSalinized
LandIrEquipDrained
LandIrEquipGround
LandIrHarvestedCropArea
LandIrWaterLogged
TotalDamCapacity
WasterwaterTreated
WasteWaterDirectNotTreated
WastewaterIrDirectTreated
WasteWaterLandEquipDirectNotTreated
WasteWaterLandEquipDirectTreated
WastewaterProduced
WastewaterTreatedReused
WaterDependencyRatio
WaterDesalinated
WaterGroundEntering
WaterGroundLeaving
WaterGroundProdInternal
WaterGroundTotal
WaterGroundWithD
WaterResExploitGround
WaterResExploitSurface
WaterResOverlap
WaterResTotalExploit
WaterResTotalRenew
WaterResTotalRenewGround
WaterResTotalRenewSurface
WaterSurfaceWithD
WaterTotalRenewPC
WaterTotalWithd
WaterTotalWithdPC
WaterTotalWithdSector
WaterTotalWithdSources
WaterWith%Agric
WaterWith%Fresh
WaterWith%Household
WaterWith%Ind
WaterWithAgr%FreshAquastat
WaterWithdAgriculture
WaterWithdIndustrial
WaterWithdMunicipal

Series that will soon be updated:

DataDict
Variable
LandIrActual%Equip
LandIrAreaEquip
LandIrEquip%Cultivated
LandIrEquip%Potential
LandIrEquip%WaterManaged
LandIrEquipActual
LandIrEquipMixed
LandIrEquipSurface
LandIrPotential
WaterTotalAgManagedArea

Preprocessor Series

Irrigation potential is the only Preprocessor Series

Country Coverage:

First, I had to adjust the Datadict. I went to the Datadict and filtered for all series that came from Aquastat. I then compared the Series codes to what was being downloaded from the aquastat database (Download from the Flat option, not table). Most codes needed to be changed in the datadict. I also added some series to the datadict. The following series were added:

Direct use of not treated municipal wastewater for irrigation purposes 

Irrigated crop intensity 

Area equipped for irrigation by surface water 

Area equipped for irrigation by groundwater 

Area equipped for irrigation by mixed surface water and groundwater 

Area equipped for irrigation by direct use of treated municipal wastewater 

Area equipped for irrigation by direct use of non-treated municipal wastewater 

Area equipped for irrigation by direct use of agricultural drainage water 

Area equipped for irrigation by desalinated water

Irrigation water withdrawal

Irrigation water requirement

Direct use of treated municipal wastewater for irrigation purposes

area equipped for irrigation: actually irrigated

area equipped for full control irrigation: total

Area equipped for full control irrigation: actually irrigated

 

The FAO Countries translation needed to be adjusted. China, Sudan, and North Sudan were all adjusted.

When uploading data from excel to Ifs: You can only download so many variables from the database at one time. I uploaded data in shifts. In Ifs, you need to uncheck data that has already been updated.

There were a few series that were not updated, as there was no new data for them on the database. These include:

LandIrEquipDesalinated

LandIrEquipDirectAg

LandIrHarvest%Equip

LandIrHarvest%FullControl

LandIrPotentialReached (There’s a note in the datadict here)