FAOstat Food and Agriculture Organization of the United Nations: Difference between revisions

From Pardee Wiki
Jump to navigation Jump to search
(FishStatJ Data Pulling)
 
(10 intermediate revisions by 2 users not shown)
Line 4: Line 4:
[https://www.fao.org/faostat/en/#home FAOSTAT] gives users access to food and agriculture data for over 245 countries and territories. Additionally, it covers all FAO regional groupings from 1961 to the most recent year available. Users are able to select different indicators from a variety of different domain groupings including Production, Investment, and Trade.
[https://www.fao.org/faostat/en/#home FAOSTAT] gives users access to food and agriculture data for over 245 countries and territories. Additionally, it covers all FAO regional groupings from 1961 to the most recent year available. Users are able to select different indicators from a variety of different domain groupings including Production, Investment, and Trade.


The data team uses FAOSTAT for a number of series including SeriesAgCropExportQuantityFAOTrade, SeriesAgFishExportsAqMammalsFAO, and SeriesAgFishProdMealFAO  to name a few. To pull data, please follow the instructions below.
== Series pulled from the FAOSTAT Trade ==
{| class="wikitable"
|Variable
|Definition
|-
|AgCropExportQuantityFAOTrade
|Quantity of Crops exported (Tonnes) from FAO Trade Domain
|-
|AgCropImportQuantityFAOTrade
|Quantity of Crops Imported (Tonnes) from FAO Trade Domain
|-
|AgMeatExportQuantityFAOTrade
|Quantity of meat exported (Tonnes) from FAO Trade Domain
|-
|AgMeatImportQuantityFAOTrade
|Quantity of Meat Imported (Tonnes) from FAO Trade Domain
|-
|AgCropExportValue%GDPFAOTrade
|Value of crops exported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $  from WDI, collapsed to match FAO FBS in IFs
|-
|AgCropImportValue%GDPFAOTrade
|Value of crops imported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to match FAO FBS in IFs
|-
|AgMeatExportValue%GDPFAOTrade
|Value of meat exported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to match FAO FBS in IFs
|-
|AgMeatImportValue%GDPFAOTrade
|Value of meat imported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to  match FAO FBS in IFs
|}
To pull data, please follow the instructions below.


== GENERAL STEPS TO PULL DATA FROM FAOSTAT ==
== GENERAL STEPS TO PULL DATA FROM FAOSTAT ==
Line 14: Line 43:




Step 3.) A page will pop up with a number of different domains, click on the one your series is in[[File:FAOSTAT Data Homepage.png|center|thumb|575x575px|List of Domains]]
Step 3.) A page will pop up with a number of different domains, click on the one your series is in[[File:FAOSTAT Data Homepage.png|center|thumb|576x576px|List of Domains]]




Line 56: Line 85:
[[File:FAOSTAT Excel Data.png|center|thumb|574x574px]]
[[File:FAOSTAT Excel Data.png|center|thumb|574x574px]]


== STEPS FOR PULLING FROM FISHSTATJ- FAO'S FISHERIES AND AQUACULTURE DATABASE SOFTWARE ==
== ADDITIONAL INFORMATION ==
Step 1. To pull data from FAO's Fisheries and Aquaculture Statistical Time Series software, FishStatJ, navigate to https://www.fao.org/fishery/en/topic/166235
For Crop and Livestock data, we are currently only looking at items with CPC codes that have "F" in front of them. TCL is the label given to trade data domain in FAOSTAT.  
[[File:FISHSTATJ IMG STEP 01.jpg|center|thumb|508x508px|FAO FishStatJ Download Page]]


The following states are included in FAOSTAT countries, but we do not have them in Ifs Countries. You will need to copy and paste the data from the below dissolved states into their new states (The general rule about merging data between current states and their former dissolved states is whichever state that inherited the capital city has the right to claim data from its former dissolved state):


Step 2. Scroll down the page until you reach <Installing FishStatJ v.4.02.08 (November 2022)>. Under <Download FishStatJ>, click on the desired operating system to download the software. This example will use the Windows version.
* China, mainland --> China
* Czechoslovakia --> Czech Republic


NOTE: Make sure your Windows version is compatible with FishStatJ before downloading. FishStatJ is compatible with Windows 10; 64-bit version; it cannot work with Windows 32-bit.
*Ethiopia PDR --> Ethiopia
[[File:FISHSTATJ IMG STEP 02.jpg|center|thumb|503x503px|FAO FishStatJ Download]]
* USSR --> Russian Federation
Step 3. After installing, go to your downloads and right click on <FishStatJ_4.02.08_Installer> and click <Open>.
* Yugoslav SFR --> Serbia
[[File:FISHSTATJ IMG STEP 03.jpg|center|thumb|505x505px|FishStatJ under Downloads]]
* Serbia and Montenegro --> Serbia
* Sudan (former) --> Sudan


<nowiki>*</nowiki>Note: When you pull Crude Materials Nes for Import or Export Quantity, the indicator will pull twice in this same document with two different element codes (5607 and 5610). You will see countries with 1961-2021 back-to-back for each. We are looking for element code 5610, not 5907, because 5907 does not have units (which should be in Tonnes).


Step 4. The following permission window will pop up. Click <Yes> to finish installing and lauch.
[[File:FISHSTATJ IMG STEP 04.jpg|center|thumb|506x506px|FishStatJ installation permission pop-up]]


The following tables are how we have aggregated FAO TCL data (what is classified as Crops, what is classified as Meat):
[[File:FAOSTAT TCL AGGREGATION TABLE IMG 01.png|center|thumb|724x724px|FAOSTAT TCL AGGREGATION TABLE IMG 01]]


Step 5. FishStatJ will immediately launch at this point. The <Workspaces Manager> page should also open automatically after launching.
[[File:FAOSTAT TCL AGGREGATION TABLE IMG 02.png|center|thumb|742x742px|FAOSTAT TCL Aggregation Table IMG 02]]
[[File:FISHSTATJ IMG STEP 05.jpg|center|thumb|507x507px|FAO's FishStatJ mainpage]]
[[File:FAOSTAT TCL AGGREGATION TABLE IMG 03.png|center|thumb|490x490px|FAOSTAT TCL Aggregation Table IMG 03]]Easy to Copy for coding:
 
{| class="wikitable"
 
|Item Code
Step 6. Select the desired workspace, then click <Download> on the right side. This example will pull data from <FAO Global Fish Trade Statistics>.
|CPC Code
[[File:FISHSTATJ IMG STEP 06.jpg|center|thumb|505x505px|FishStatJ Workspaces Manager pop-up]]
|Item
 
|Item Group
 
|-
Step 7. The following page will populate. Click <Next> two times, then click <Finish>.
|1907
[[File:FISHSTATJ IMG STEP 07.jpg|center|thumb|505x505px|FishStatJ Workspace Download]]
|'F1907
[[File:FISHSTATJ IMG STEP 07(2).jpg|center|thumb|506x506px|FishStatJ Workspace Import]]
|Alcoholic Beverages
[[File:FISHSTATJ IMG STEP 07(3).jpg|center|thumb|505x505px|FishStatJ Workspace Import Finish]]
|Crops
 
|-
 
|1941
Step 8. The <Dataset Browser> page will then pop up. You can select to have the dataset by partner country or all partners aggregated. This example will select <All partners aggregated>. Click <OK> on bottom right of page to open up the dataset.
|'F1941
[[File:FISHSTATJ IMG STEP 08.jpg|center|thumb|503x503px|FishStatJ Dataset Options]]
|Cereal preparations total
 
|Crops
 
|-
Step 9. The following page will populate. To export the data, click on <File> in the top left corner, then select <Export Selection (CSV file)...> OR use command Ctrl + S. Name the CSV file then save it into an appropriate place.
|1944
[[File:FISHSTATJ IMG STEP 09.jpg|center|thumb|507x507px|FishStatJ Final Dataset]]
|'F1944
 
|Cereals
 
|Crops
Step 10. Opening up the CSV file in Excel will formulate the following page. Make sure to save the file as an *.xls or *.xlsx to prevent any possible data loss.
|-
[[File:FISHSTATJ IMG STEP 10.jpg|center|thumb|503x503px|FishStatJ Excel File]]
|1972
|'F1972
|Flowers
|Crops
|-
|1802
|'F1802
|Fruit
|Crops
|-
|1900
|'F1900
|Natural Rubber
|Crops
|-
|1908
|'F1908
|Non-alcoholic Beverages
|Crops
|-
|1773
|'F1773
|Nuts
|Crops
|-
|1899
|'F1899
|Oilseeds
|Crops
|-
|1849
|'F1849
|Other food nes
|Crops
|-
|1954
|'F1954
|Pulses
|Crops
|-
|1719
|'F1719
|Roots and Tubers
|Crops
|-
|1723
|'F1723
|Sugar Crops Primary
|Crops
|-
|1901
|'F1901
|Textile Fibres
|Crops
|-
|1788
|'F1788
|Vegetable Oil and Fat
|Crops
|-
|1734
|'F1734
|Vegetables
|Crops
|-
|1975
|'F1975
|Animal Fats and Oils (excl. Butter)
|Meat
|-
|2071
|'F2071
|Bovine Meat
|Meat
|-
|1902
|'F1902
|Crude Materials nes
|Meat
|-
|1887
|'F1887
|Dairy Products
|Meat
|-
|1782
|'F1782
|Eggs
|Meat
|-
|1898
|'F1898
|Hides and skins
|Meat
|-
|2076
|'F2076
|Other Meat
|Meat
|-
|2073
|'F2073
|Pigmeat (meat equivalent)
|Meat
|-
|2074
|'F2074
|Poultry Meat
|Meat
|}

Latest revision as of 18:00, 2 April 2024


SUMMARY

FAOSTAT gives users access to food and agriculture data for over 245 countries and territories. Additionally, it covers all FAO regional groupings from 1961 to the most recent year available. Users are able to select different indicators from a variety of different domain groupings including Production, Investment, and Trade.

Series pulled from the FAOSTAT Trade

Variable Definition
AgCropExportQuantityFAOTrade Quantity of Crops exported (Tonnes) from FAO Trade Domain
AgCropImportQuantityFAOTrade Quantity of Crops Imported (Tonnes) from FAO Trade Domain
AgMeatExportQuantityFAOTrade Quantity of meat exported (Tonnes) from FAO Trade Domain
AgMeatImportQuantityFAOTrade Quantity of Meat Imported (Tonnes) from FAO Trade Domain
AgCropExportValue%GDPFAOTrade Value of crops exported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to match FAO FBS in IFs
AgCropImportValue%GDPFAOTrade Value of crops imported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to match FAO FBS in IFs
AgMeatExportValue%GDPFAOTrade Value of meat exported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to match FAO FBS in IFs
AgMeatImportValue%GDPFAOTrade Value of meat imported (1000$ US) from FAO Trade Domain, as a percent of GDP at current $ from WDI, collapsed to match FAO FBS in IFs

To pull data, please follow the instructions below.

GENERAL STEPS TO PULL DATA FROM FAOSTAT

Step 1.) Navigate to the homepage of FAOSTAT

Step 2.) Near the top of the page, click on the tab labeled "Data"

FAOSTAT Homepage


Step 3.) A page will pop up with a number of different domains, click on the one your series is in

List of Domains


VARIABLE EXAMPLE: SeriesAgMeatImportValueFAOTrade

Step 4.) SeriesAgMeatImportValueFAOTrade in IFs is under the "Trade" category, select this to bring down a menu

Select the Domain


Step 5.) Click on "Crops and livestock products", a new page will appear

Select the Database in Domain


Step 6.) Under "Countries" on the right hand side, select "Select All"

Select (All) Countries


Step 7.) Under "Years" on the left hand side, select "Select All"

Select (All) Years


Step 8.) Under "Elements" on the right hand side, select "Import Value"

Select the Element


Step 9.) On the bottom left side, next to the tab "Items", select "Items Aggregated"

Click Items Aggregated


Step 10.) Next to the section "Crops and livestock products > (List)", click on the > button to bring down a list of different variables

Click the Dropdown arrow


Step 11.) Scroll down and select "Meat and Meat Preparations + (Total)"

Select the Variable


Step 12.) Scroll down and select "Download Data"

Click "Download"

Step 13.) An Excel sheet will download. Now you can format the data to upload it into IFs. To import data into IFs, please follow the instructions found in the Importing Data (general instructions) page.

FAOSTAT Excel Data.png

ADDITIONAL INFORMATION

For Crop and Livestock data, we are currently only looking at items with CPC codes that have "F" in front of them. TCL is the label given to trade data domain in FAOSTAT.

The following states are included in FAOSTAT countries, but we do not have them in Ifs Countries. You will need to copy and paste the data from the below dissolved states into their new states (The general rule about merging data between current states and their former dissolved states is whichever state that inherited the capital city has the right to claim data from its former dissolved state):

  • China, mainland --> China
  • Czechoslovakia --> Czech Republic
  • Ethiopia PDR --> Ethiopia
  • USSR --> Russian Federation
  • Yugoslav SFR --> Serbia
  • Serbia and Montenegro --> Serbia
  • Sudan (former) --> Sudan

*Note: When you pull Crude Materials Nes for Import or Export Quantity, the indicator will pull twice in this same document with two different element codes (5607 and 5610). You will see countries with 1961-2021 back-to-back for each. We are looking for element code 5610, not 5907, because 5907 does not have units (which should be in Tonnes).


The following tables are how we have aggregated FAO TCL data (what is classified as Crops, what is classified as Meat):

FAOSTAT TCL AGGREGATION TABLE IMG 01
FAOSTAT TCL Aggregation Table IMG 02
FAOSTAT TCL Aggregation Table IMG 03

Easy to Copy for coding:

Item Code CPC Code Item Item Group
1907 'F1907 Alcoholic Beverages Crops
1941 'F1941 Cereal preparations total Crops
1944 'F1944 Cereals Crops
1972 'F1972 Flowers Crops
1802 'F1802 Fruit Crops
1900 'F1900 Natural Rubber Crops
1908 'F1908 Non-alcoholic Beverages Crops
1773 'F1773 Nuts Crops
1899 'F1899 Oilseeds Crops
1849 'F1849 Other food nes Crops
1954 'F1954 Pulses Crops
1719 'F1719 Roots and Tubers Crops
1723 'F1723 Sugar Crops Primary Crops
1901 'F1901 Textile Fibres Crops
1788 'F1788 Vegetable Oil and Fat Crops
1734 'F1734 Vegetables Crops
1975 'F1975 Animal Fats and Oils (excl. Butter) Meat
2071 'F2071 Bovine Meat Meat
1902 'F1902 Crude Materials nes Meat
1887 'F1887 Dairy Products Meat
1782 'F1782 Eggs Meat
1898 'F1898 Hides and skins Meat
2076 'F2076 Other Meat Meat
2073 'F2073 Pigmeat (meat equivalent) Meat
2074 'F2074 Poultry Meat Meat