Data (New) - Revision history

Yutang.Xiong: Yutang.Xiong moved page Date (New) to Data (New) without leaving a redirect

2025-02-20T21:07:35Z

Yutang.Xiong moved page Date (New) to Data (New) without leaving a redirect

← Older revision	Revision as of 21:07, 20 February 2025
(No difference)

Yutang.Xiong: /* Data Collection & Update */

2025-02-11T21:52:49Z

Data Collection & Update

← Older revision		Revision as of 21:52, 11 February 2025
Line 32:		Line 32:
	IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.		IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.

	Details on data collection methods are available on each source's introduction page. Here is [[Data Sources\|the list of data sources]].		Details on data collection methods are available on each source's introduction page. Here is [[Data Sources\|'''the list of data sources''']].

Yutang.Xiong: /* Data Collection & Update */

2025-02-11T21:48:49Z

Data Collection & Update

← Older revision		Revision as of 21:48, 11 February 2025
Line 32:		Line 32:
	IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.		IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.

	Details on data collection methods are available on each source's introduction page. ~~You can find~~ the list of data sources ~~here [a wiki link to all the data sources~~].		Details on data collection methods are available on each source's introduction page. Here is [[Data Sources\|the list of data sources]].

Yutang.Xiong at 21:41, 11 February 2025

2025-02-11T21:41:38Z

← Older revision		Revision as of 21:41, 11 February 2025
Line 1:		Line 1:
	== ~~'''~~Database Files in IFs~~'''~~ ==		== Database Files in IFs ==

	=== Historical Databases ===		==== '''Historical Databases''' ====
	The International Futures (IFs) modeling system relies on two major large historical databases: ''IFsHistSeries.db'' and ''IFsHistSeriesDyadic.db''.		The International Futures (IFs) modeling system relies on two major large historical databases: ''IFsHistSeries.db'' and ''IFsHistSeriesDyadic.db''.

Line 19:		Line 19:
	For a deeper dive into the database structure, check out [a wiki link to IFsHistSeries & IFsHistSeriesDyadic].		For a deeper dive into the database structure, check out [a wiki link to IFsHistSeries & IFsHistSeriesDyadic].

	=== Metadata ===		==== Metadata ====
	All metadata—such as definitions, units, and data sources—are stored separately in data dictionary files (''DataDict.db'' for monadic data and ''DataDictDyadic.db'' for dyadic data). Each data series in the historical databases is referenced by a corresponding entry in the data dictionary. Users can access metadata directly through the database files or via the ''Data Information'' tab in the IFs interface when available.		All metadata—such as definitions, units, and data sources—are stored separately in data dictionary files (''DataDict.db'' for monadic data and ''DataDictDyadic.db'' for dyadic data). Each data series in the historical databases is referenced by a corresponding entry in the data dictionary. Users can access metadata directly through the database files or via the ''Data Information'' tab in the IFs interface when available.

	For more details on the data dictionary structure, click [a wiki link to DataDict].		For more details on the data dictionary structure, click [a wiki link to DataDict].

	=== Sing-Year Data and Parameters ===		==== Sing-Year Data and Parameters ====
	Beyond historical databases, IFs also uses single-year data for model initialization and projections. These datasets are typically stored in ''IFs.db'', along with various model parameters and settings, including C''ountry Concordance'' tables.		Beyond historical databases, IFs also uses single-year data for model initialization and projections. These datasets are typically stored in ''IFs.db'', along with various model parameters and settings, including C''ountry Concordance'' tables.

	More information on ''IFs.db'' tables can be found [here].		More information on ''IFs.db'' tables can be found [here].

	== ~~'''~~Data Collection & Update~~'''~~ ==		== Data Collection & Update ==
	IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.		IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.

	Details on data collection methods are available on each source's introduction page. You can find the list of data sources here [a wiki link to all the data sources].		Details on data collection methods are available on each source's introduction page. You can find the list of data sources here [a wiki link to all the data sources].

Yutang.Xiong: /* Meta Data */

2025-02-11T21:40:49Z

Meta Data

Yutang.Xiong at 21:34, 11 February 2025

2025-02-11T21:34:19Z

← Older revision		Revision as of 21:34, 11 February 2025
Line 2:		Line 2:

	=== Historical Databases ===		=== Historical Databases ===
	International Futures (IFs) modeling ~~application contains~~ two large historical databases, IFsHistSeries & IFsHistSeriesDyadic. The former provides monadic information (values per entity), and the latter provides bilateral information (values per entity-pair). These databases consist of a large collection of time-series tables. Hence, each data table is called a data series in the IFs system. These data series cover a large number of variables on IFs model issue areas like population, education, health, agriculture, energy, economics, environment, infrastructure, governance and international politics.		The International Futures (IFs) modeling system relies on two major large historical databases: '''IFsHistSeries''' and '''IFsHistSeriesDyadic'''.

	~~At present IFs data tables contain~~ data for ~~188 entities (~~countries/regions). ~~Temporal coverage, in most cases, start in 1960~~.		* '''IFsHistSeries''' contains data for individual countries and regions (''monadic data'').
			* '''IFsHistSeriesDyadic''' holds data on relationships between country pairs (''bilateral data'').

	~~The model uses these~~ data tables to,		Both databases store a vast collection of time-series data tables covering areas like population, education, health, agriculture, energy, economics, the environment, infrastructure, governance, and international politics. Hence, each data table is also referred to as a data series. Currently, these data series include '''188 entities (countries/regions)''', with most data series going back to '''1960'''.

	~~1. Initialize values for~~ IFs ~~variables~~ in ~~the base year. These tables are also called preprocessors series.~~		The IFs model uses these data series in several ways:

	2. ~~Build models to~~ analyze ~~and use the relationships~~ between variables. These tables are also ~~called~~ series for ~~analytical functions~~.		# '''Initializing model variables'''—these series act as ''preprocessors'' that set the base-year values for the model.
			# '''Building relationships between variables'''—helping IFs analyze connections between different variables, e.g., through a statistical model. These tables serve as ''Analytical Function'' Series.
			# '''Displaying historical trends'''—providing users with visual insights into past patterns. These are also referred to as series for ''Historical Analog''.
			# '''Incorporating external projections'''—allowing comparisons with forecasts from other organizations. Furthermore, some of these series can be made exogenous in IFs to change model projections.
			# '''Helping users explore patterns and relationships'''—supporting research, analysis, and parameter estimation.

	~~3. Display historical trends in~~ the ~~IFs interface. These tables are also referred to as historical analog series.~~		For a deeper dive into the database structure, check out [a wiki link to IFsHistSeries & IFsHistSeriesDyadic].

	~~4. Provide projections from other agencies for comparisons and analysis.~~

	~~5. Enables model users~~ to ~~explore patterns, understand relationships and estimate parameters.~~

	~~More details on the structure of historical databases can be found here~~.

	=== Meta Data ===		=== Meta Data ===

Yutang.Xiong: Created page with "== '''Database Files in IFs''' == === Historical Databases === International Futures (IFs) modeling application contains two large historical databases, IFsHistSeries & IFsHistSeriesDyadic. The former provides monadic information (values per entity), and the latter provides bilateral information (values per entity-pair). These databases consist of a large collection of time-series tables. Hence, each data table is called a data series in the IFs system. These data serie..."

2025-02-11T21:21:32Z

Created page with "== '''Database Files in IFs''' == === Historical Databases === International Futures (IFs) modeling application contains two large historical databases, IFsHistSeries & IFsHistSeriesDyadic. The former provides monadic information (values per entity), and the latter provides bilateral information (values per entity-pair). These databases consist of a large collection of time-series tables. Hence, each data table is called a data series in the IFs system. These data serie..."

New page

== '''Database Files in IFs''' ==

=== Historical Databases ===
International Futures (IFs) modeling application contains two large historical databases, IFsHistSeries & IFsHistSeriesDyadic. The former provides monadic information (values per entity), and the latter provides bilateral information (values per entity-pair). These databases consist of a large collection of time-series tables. Hence, each data table is called a data series in the IFs system. These data series cover a large number of variables on IFs model issue areas like population, education, health, agriculture, energy, economics, environment, infrastructure, governance and international politics.

At present IFs data tables contain data for 188 entities (countries/regions). Temporal coverage, in most cases, start in 1960.

The model uses these data tables to,

1. Initialize values for IFs variables in the base year. These tables are also called preprocessors series.

2. Build models to analyze and use the relationships between variables. These tables are also called series for analytical functions.

3. Display historical trends in the IFs interface. These tables are also referred to as historical analog series.

4. Provide projections from other agencies for comparisons and analysis.

5. Enables model users to explore patterns, understand relationships and estimate parameters.

More details on the structure of historical databases can be found here.

=== Meta Data ===
All meta data (e.g., definitions, units, data source) are stored separately under the data dictionary files (DataDict.db or DataDictDyadic.db). For each data series in the historical databases, we have a reference (one row) in the data dictionary. IFs users can access this information directly through the database files, or through the IFs interface by clicking the Data Information tab when available.

Detailed description on the structure of data dictionary files can be found here.

=== Sing-Year Data and Parameters ===
In addition to historical databases. IFs sometimes relies on single-year data in its model initialization and projection. Single-year data are normally stored under the file IFs.db. Some model parameters and settings, such as country concordance tables, can also be found under the same file. You can find more information about tables in the IFs.db here.

== '''Data Collection & Update''' ==
IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. When needed, new series will be added to the databases, while existing ones are updated by data sources on a regular basis.

Introductions on data collection can be traced using the list of data sources here.

← Older revision		Revision as of 21:40, 11 February 2025
Line 2:		Line 2:

	=== Historical Databases ===		=== Historical Databases ===
	The International Futures (IFs) modeling system relies on two major large historical databases: '''IFsHistSeries''' and '''IFsHistSeriesDyadic'''.		The International Futures (IFs) modeling system relies on two major large historical databases: ''IFsHistSeries.db'' and ''IFsHistSeriesDyadic.db''.

	* '''IFsHistSeries''' contains data for individual countries and regions (''monadic data'').		* ''IFsHistSeries'' contains data for individual countries and regions (''monadic data'').
	* '''IFsHistSeriesDyadic''' holds data on relationships between country pairs (''bilateral data'').		* ''IFsHistSeriesDyadic'' holds data on relationships between country pairs (''bilateral data'').

	Both databases store a vast collection of time-series data tables covering areas like population, education, health, agriculture, energy, economics, the environment, infrastructure, governance, and international politics. Hence, each data table is also referred to as a data series. Currently, these data series include ~~'''~~188 entities (countries/regions)~~'''~~, with most data series going back to ~~'''~~1960~~'''~~.		Both databases store a vast collection of time-series data tables covering areas like population, education, health, agriculture, energy, economics, the environment, infrastructure, governance, and international politics. Hence, each data table is also referred to as a data series. Currently, these data series include 188 entities (countries/regions), with most data series going back to 1960.

	The IFs model uses these data series in several ways:		The IFs model uses these data series in several ways:

	# ~~'''~~Initializing model ~~variables'''—these~~ series act as ''preprocessors'' that set the base-year values for the model.		# Initializing model variables—these series act as ''preprocessors'' that set the base-year values for the model.
	# ~~'''~~Building relationships between ~~variables'''—helping~~ IFs analyze connections between different variables, e.g., through a statistical model. These tables serve as ''Analytical Function'' Series.		# Building relationships between variables—helping IFs analyze connections between different variables, e.g., through a statistical model. These tables serve as ''Analytical Function'' Series.
	# ~~'''~~Displaying historical ~~trends'''—providing~~ users with visual insights into past patterns. These are also referred to as series for ''Historical Analog''.		# Displaying historical trends—providing users with visual insights into past patterns. These are also referred to as series for ''Historical Analog''.
	# ~~'''~~Incorporating external ~~projections'''—allowing~~ comparisons with forecasts from other organizations. Furthermore, some of these series can be made exogenous in IFs to change model projections.		# Incorporating external projections—allowing comparisons with forecasts from other organizations. Furthermore, some of these series can be made exogenous in IFs to change model projections.
	# ~~'''~~Helping users explore patterns and ~~relationships'''—supporting~~ research, analysis, and parameter estimation.		# Helping users explore patterns and relationships—supporting research, analysis, and parameter estimation.

	For a deeper dive into the database structure, check out [a wiki link to IFsHistSeries & IFsHistSeriesDyadic].		For a deeper dive into the database structure, check out [a wiki link to IFsHistSeries & IFsHistSeriesDyadic].

	=== ~~Meta Data~~ ===		=== Metadata ===
	All ~~meta data (e.g.,~~ definitions, units, data ~~source) are~~ stored separately ~~under the~~ data dictionary files (DataDict.db or DataDictDyadic.db). ~~For each~~ data series in the historical databases~~, we have~~ a ~~reference (one row)~~ in the data dictionary. ~~IFs users~~ can access ~~this information~~ directly through the database files, or ~~through the IFs interface by clicking~~ the Data Information tab when available.		All metadata—such as definitions, units, and data sources—are stored separately in data dictionary files (''DataDict.db'' for monadic data and ''DataDictDyadic.db'' for dyadic data). Each data series in the historical databases is referenced by a corresponding entry in the data dictionary. Users can access metadata directly through the database files or via the ''Data Information'' tab in the IFs interface when available.

	~~Detailed description~~ on the ~~structure of~~ data dictionary ~~files can be found here~~.		For more details on the data dictionary structure, click [a wiki link to DataDict].

	=== Sing-Year Data and Parameters ===		=== Sing-Year Data and Parameters ===
	~~In addition to~~ historical databases. IFs ~~sometimes relies on~~ single-year data ~~in its~~ model initialization and ~~projection~~. ~~Single-year data~~ are ~~normally~~ stored ~~under the file~~ IFs.db~~. Some~~ model parameters and settings, ~~such as country concordance~~ tables~~, can also be found under the same file~~. ~~You can find more~~ information ~~about tables in the~~ IFs.db here.		Beyond historical databases, IFs also uses single-year data for model initialization and projections. These datasets are typically stored in ''IFs.db'', along with various model parameters and settings, including C''ountry Concordance'' tables.

			More information on ''IFs.db'' tables can be found [here].

	== '''Data Collection & Update''' ==		== '''Data Collection & Update''' ==
	IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. ~~When needed, new~~ series ~~will be~~ added ~~to the databases~~, ~~while~~ existing ones are updated ~~by data sources~~ on ~~a regular basis~~.		IFs databases are compiled, in most cases, from publicly available data sources, e.g., World Development Indicators, UNESCO Institute for Education database on education, FAO database on agricultural production, Correlates of War data on conflicts etc. New data series are added as needed, and existing ones are regularly updated based on source revisions.

	~~Introductions~~ on data collection can ~~be traced using~~ the list of data sources here.		Details on data collection methods are available on each source's introduction page. You can find the list of data sources here [a wiki link to all the data sources].