Alternative Data Sources - Revision history

AltheaDitter at 21:42, 25 May 2017

2017-05-25T21:42:40Z

← Older revision		Revision as of 21:42, 25 May 2017
Line 7:		Line 7:
	[[File:ChinaPopulation v728.jpg\|RTENOTITLE]]		[[File:ChinaPopulation v728.jpg\|RTENOTITLE]]

	~~The~~ provincial population series ~~for China's subregional model~~ came from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] from 1996-2016. These yearbooks are available online on the [[Media:National_Bureau_of_Statistics_of_China_website\|National Bureau of Statistics of China website~~]]. There are other sources available for provincial population data in China, which can be read about at [[Alternative_Data_Sources\|Alternative Population Data Sources~~]]. The population data is published in tens of thousands, rather than the millions that are used in the full 186 version of IFs. Rather than converting the population data into millions, the population series was imported as it was published in tens of thousands and [[ApplyMultAll\|ApplyMultAll]] is selected in the data dictionary. This normalizes the historical data to the population of China in the full 186 version of IFs. This choice to normalize rather than change units is meant to decrease the likelihood of human error, and simplify future data updates.		This provincial population series came from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] from 1996-2016. These yearbooks are available online on the [[Media:National_Bureau_of_Statistics_of_China_website\|National Bureau of Statistics of China website]]. The population data is published in tens of thousands, rather than the millions that are used in the full 186 version of IFs. Rather than converting the population data into millions, the population series was imported as it was published in tens of thousands and [[ApplyMultAll\|ApplyMultAll]] is selected in the data dictionary. This normalizes the historical data to the population of China in the full 186 version of IFs. This choice to normalize rather than change units is meant to decrease the likelihood of human error, and simplify future data updates.

	= [[Central_Statistics_Organization\|Central Statistics Organization]] =		= [[Central_Statistics_Organization\|Central Statistics Organization]] =

AltheaDitter at 21:40, 25 May 2017

2017-05-25T21:40:34Z

← Older revision		Revision as of 21:40, 25 May 2017
Line 1:		Line 1:
	= [[Central_Statistics_Organization\|~~Central_Statistics_Organization~~]] =		= [[China_Statistical_Yearbook\|China Statistical Yearbook]] =

			This provincial population series for China runs from 1995 through 2015. The original data lacked observations for Chongqing in 1995 and 1996 because Chongqing did not gain its status as a municipality until 1997. Chongqing was part of Sichuan province prior to 1997 and thus, Sichuan province's data included Chongqing in 1995 and 1996 and there was a substantial drop in Sichuan province in 1997. To remedy this issue, the ratio of population in Chongqing relative to the sum of Sichuan province and Chongqing in 1997 was used to estimate the population in Chongqing in 1995 and 1996. This population estimate for Chongqing was subtracted from Sichuan's population in 1995 and 1996. This provides a smoother and more accurate historical series. and data for Chongqing and Sichuan province were adjusted/estimated for 1995 and 1996.

			Despite this estimation, there are still some spikes and drops in the population data around 2000. Guangdong has the most noticeable shift, where in 1999 population is 73.9 million and in 2000 population jumps up to 86.9. These shifts in the data are indeed in the data and not human errors. The data source was contact regarding this and other potential data issues that were found while pulling data, they have yet to respond. It is believed that the jumps in the data can be explained through redistricting/rezoning.

			[[File:ChinaPopulation v728.jpg\|RTENOTITLE]]

			The provincial population series for China's subregional model came from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] from 1996-2016. These yearbooks are available online on the [[Media:National_Bureau_of_Statistics_of_China_website\|National Bureau of Statistics of China website]]. There are other sources available for provincial population data in China, which can be read about at [[Alternative_Data_Sources\|Alternative Population Data Sources]]. The population data is published in tens of thousands, rather than the millions that are used in the full 186 version of IFs. Rather than converting the population data into millions, the population series was imported as it was published in tens of thousands and [[ApplyMultAll\|ApplyMultAll]] is selected in the data dictionary. This normalizes the historical data to the population of China in the full 186 version of IFs. This choice to normalize rather than change units is meant to decrease the likelihood of human error, and simplify future data updates.

			= [[Central_Statistics_Organization\|Central Statistics Organization]] =

	In previous versions of the China subregional model a population series that ran from 1960 through 2013 was used. The previous data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The  source has not been found and some of the data was questionable. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some unexpected observations for Chongqing. There is a single data point in 1982 that is as high as the population throughout the 2000s. Moreover, the next observation is the mid 1990s is about a tenth of the 1982 value. After 1998 Chongqing's population rapidly increases ten-fold to around 30 million. All of this made this unknown population source unusable.		In previous versions of the China subregional model a population series that ran from 1960 through 2013 was used. The previous data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The  source has not been found and some of the data was questionable. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some unexpected observations for Chongqing. There is a single data point in 1982 that is as high as the population throughout the 2000s. Moreover, the next observation is the mid 1990s is about a tenth of the 1982 value. After 1998 Chongqing's population rapidly increases ten-fold to around 30 million. All of this made this unknown population source unusable.

	= [[China_Data_Center\|~~China_Data_Center~~]] =		= [[China_Data_Center\|China Data Center]] =

	The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.		The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.

AltheaDitter at 18:34, 13 April 2017

2017-04-13T18:34:11Z

← Older revision		Revision as of 18:34, 13 April 2017
Line 1:		Line 1:
	= [[Central_Statistics_Organization\|Central_Statistics_Organization]] =		= [[Central_Statistics_Organization\|Central_Statistics_Organization]] =

	~~The original version~~ of the China subregional model ~~had~~ a population series that ran from 1960 through 2013. The ~~original~~ data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The ~~original~~ source has not been found ~~and because the source could not be verified~~ and some of the data ~~appeared~~ questionable~~, this population series is not being used~~. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some ~~large transient~~ data ~~points such~~ as ~~a large~~ population ~~(nearly three times~~ the ~~1998 value)~~ ~~for~~ Chongqing ~~in 1970 (when the municipality should not have had data)~~.		In previous versions of the China subregional model a population series that ran from 1960 through 2013 was used. The previous data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The  source has not been found and some of the data was questionable. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some unexpected observations for Chongqing. There is a single data point in 1982 that is as high as the population throughout the 2000s. Moreover, the next observation is the mid 1990s is about a tenth of the 1982 value. After 1998 Chongqing's population rapidly increases ten-fold to around 30 million. All of this made this unknown population source unusable.

	= [[China_Data_Center\|China_Data_Center]] =		= [[China_Data_Center\|China_Data_Center]] =

	The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.		The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.

AltheaDitter at 18:26, 13 April 2017

2017-04-13T18:26:03Z

← Older revision		Revision as of 18:26, 13 April 2017
Line 5:		Line 5:
	= [[China_Data_Center\|China_Data_Center]] =		= [[China_Data_Center\|China_Data_Center]] =

	The China Data Center database from the University of Michigan ~~has~~ population data from 1949 through 2003. This data was considered as a potential source ~~for blending~~ with the current population data to provide a longer historical time series. However, the series ~~was~~ not blended because the data from 1995 through 2003, where the two series had overlap, did not match.		The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.

AltheaDitter at 18:23, 13 April 2017

2017-04-13T18:23:46Z

← Older revision		Revision as of 18:23, 13 April 2017
Line 1:		Line 1:
	= [[Central_Statistics_Organization\|Central_Statistics_Organization]] =		= [[Central_Statistics_Organization\|Central_Statistics_Organization]] =

	The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The ~~largest issue with the data~~ was the appearance of ~~possible~~ sorting errors and some large transient data points~~, most noticably~~ in ~~Chongqing during years prior to 1997,~~ when ~~it became a~~ municipality.		The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some large transient data points such as a large population (nearly three times the 1998 value) for Chongqing in 1970 (when the municipality should not have had data).

	= [[China_Data_Center\|China_Data_Center]] =		= [[China_Data_Center\|China_Data_Center]] =

	The China Data Center database from the University of Michigan has population data from 1949 through 2003. This data was considered as a potential source for blending with the current population data to provide a longer historical time series. However, the series was not blended because the data from 1995 through 2003, where the two series had overlap, did not match.		The China Data Center database from the University of Michigan has population data from 1949 through 2003. This data was considered as a potential source for blending with the current population data to provide a longer historical time series. However, the series was not blended because the data from 1995 through 2003, where the two series had overlap, did not match.

AltheaDitter at 18:50, 16 March 2017

2017-03-16T18:50:23Z

← Older revision		Revision as of 18:50, 16 March 2017
Line 1:		Line 1:
	= [[Central_Statistics_Organization]] =		= [[Central_Statistics_Organization\|Central_Statistics_Organization]] =

	The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The largest issue with the data was the appearance of possible sorting errors and some large transient data points, most noticably in Chongqing during years prior to 1997, when it became a municipality.		The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The largest issue with the data was the appearance of possible sorting errors and some large transient data points, most noticably in Chongqing during years prior to 1997, when it became a municipality.

	= [[China_Data_Center]] =		= [[China_Data_Center\|China_Data_Center]] =

	The China Data Center database from the University of Michigan has population data from 1949 through 2003. This data was considered as a potential source for blending with the current population data to provide a longer historical time series. However, the series was not blended because the data from 1995 through 2003, where the two series had overlap, did not match.		The China Data Center database from the University of Michigan has population data from 1949 through 2003. This data was considered as a potential source for blending with the current population data to provide a longer historical time series. However, the series was not blended because the data from 1995 through 2003, where the two series had overlap, did not match.

AltheaDitter at 18:50, 16 March 2017

2017-03-16T18:50:10Z

← Older revision		Revision as of 18:50, 16 March 2017
Line 1:		Line 1:
	= ~~Central Statistics Organization~~ =		= [[Central_Statistics_Organization]] =

	The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The largest issue with the data was the appearance of possible sorting errors and some large transient data points, most noticably in Chongqing during years prior to 1997, when it became a municipality.		The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The largest issue with the data was the appearance of possible sorting errors and some large transient data points, most noticably in Chongqing during years prior to 1997, when it became a municipality.

	= China Data Center =		= [[China_Data_Center]] =

			The China Data Center database from the University of Michigan has population data from 1949 through 2003. This data was considered as a potential source for blending with the current population data to provide a longer historical time series. However, the series was not blended because the data from 1995 through 2003, where the two series had overlap, did not match.

AltheaDitter: Created page with "= Central Statistics Organization = The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary..."

2017-03-16T18:45:14Z

Created page with "= Central Statistics Organization = The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary..."

New page

= Central Statistics Organization =

The original version of the China subregional model had a population series that ran from 1960 through 2013. The original data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The original source has not been found and because the source could not be verified and some of the data appeared questionable, this population series is not being used. The largest issue with the data was the appearance of possible sorting errors and some large transient data points, most noticably in Chongqing during years prior to 1997, when it became a municipality.

= China Data Center =

← Older revision		Revision as of 21:42, 25 May 2017
Line 7:		Line 7:
	[[File:ChinaPopulation v728.jpg\|RTENOTITLE]]		[[File:ChinaPopulation v728.jpg\|RTENOTITLE]]

	~~The~~ provincial population series ~~for China's subregional model~~ came from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] from 1996-2016. These yearbooks are available online on the [[Media:National_Bureau_of_Statistics_of_China_website\|National Bureau of Statistics of China website~~]]. There are other sources available for provincial population data in China, which can be read about at [[Alternative_Data_Sources\|Alternative Population Data Sources~~]]. The population data is published in tens of thousands, rather than the millions that are used in the full 186 version of IFs. Rather than converting the population data into millions, the population series was imported as it was published in tens of thousands and [[ApplyMultAll\|ApplyMultAll]] is selected in the data dictionary. This normalizes the historical data to the population of China in the full 186 version of IFs. This choice to normalize rather than change units is meant to decrease the likelihood of human error, and simplify future data updates.		This provincial population series came from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] from 1996-2016. These yearbooks are available online on the [[Media:National_Bureau_of_Statistics_of_China_website\|National Bureau of Statistics of China website]]. The population data is published in tens of thousands, rather than the millions that are used in the full 186 version of IFs. Rather than converting the population data into millions, the population series was imported as it was published in tens of thousands and [[ApplyMultAll\|ApplyMultAll]] is selected in the data dictionary. This normalizes the historical data to the population of China in the full 186 version of IFs. This choice to normalize rather than change units is meant to decrease the likelihood of human error, and simplify future data updates.

	= [[Central_Statistics_Organization\|Central Statistics Organization]] =		= [[Central_Statistics_Organization\|Central Statistics Organization]] =

← Older revision		Revision as of 21:40, 25 May 2017
Line 1:		Line 1:
	= [[Central_Statistics_Organization\|~~Central_Statistics_Organization~~]] =		= [[China_Statistical_Yearbook\|China Statistical Yearbook]] =

			This provincial population series for China runs from 1995 through 2015. The original data lacked observations for Chongqing in 1995 and 1996 because Chongqing did not gain its status as a municipality until 1997. Chongqing was part of Sichuan province prior to 1997 and thus, Sichuan province's data included Chongqing in 1995 and 1996 and there was a substantial drop in Sichuan province in 1997. To remedy this issue, the ratio of population in Chongqing relative to the sum of Sichuan province and Chongqing in 1997 was used to estimate the population in Chongqing in 1995 and 1996. This population estimate for Chongqing was subtracted from Sichuan's population in 1995 and 1996. This provides a smoother and more accurate historical series. and data for Chongqing and Sichuan province were adjusted/estimated for 1995 and 1996.

			Despite this estimation, there are still some spikes and drops in the population data around 2000. Guangdong has the most noticeable shift, where in 1999 population is 73.9 million and in 2000 population jumps up to 86.9. These shifts in the data are indeed in the data and not human errors. The data source was contact regarding this and other potential data issues that were found while pulling data, they have yet to respond. It is believed that the jumps in the data can be explained through redistricting/rezoning.

			[[File:ChinaPopulation v728.jpg\|RTENOTITLE]]

			The provincial population series for China's subregional model came from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] from 1996-2016. These yearbooks are available online on the [[Media:National_Bureau_of_Statistics_of_China_website\|National Bureau of Statistics of China website]]. There are other sources available for provincial population data in China, which can be read about at [[Alternative_Data_Sources\|Alternative Population Data Sources]]. The population data is published in tens of thousands, rather than the millions that are used in the full 186 version of IFs. Rather than converting the population data into millions, the population series was imported as it was published in tens of thousands and [[ApplyMultAll\|ApplyMultAll]] is selected in the data dictionary. This normalizes the historical data to the population of China in the full 186 version of IFs. This choice to normalize rather than change units is meant to decrease the likelihood of human error, and simplify future data updates.

			= [[Central_Statistics_Organization\|Central Statistics Organization]] =

	In previous versions of the China subregional model a population series that ran from 1960 through 2013 was used. The previous data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The  source has not been found and some of the data was questionable. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some unexpected observations for Chongqing. There is a single data point in 1982 that is as high as the population throughout the 2000s. Moreover, the next observation is the mid 1990s is about a tenth of the 1982 value. After 1998 Chongqing's population rapidly increases ten-fold to around 30 million. All of this made this unknown population source unusable.		In previous versions of the China subregional model a population series that ran from 1960 through 2013 was used. The previous data dictionary entry for this series said that the population series was sourced from the Central Statistics Organization and that there was data for 1999 and 2003, which was clearly incorrect. The  source has not been found and some of the data was questionable. The prominent red flag was the appearance of what may have been sorting errors, where data for some provinces appeared to be switched over several years, and some unexpected observations for Chongqing. There is a single data point in 1982 that is as high as the population throughout the 2000s. Moreover, the next observation is the mid 1990s is about a tenth of the 1982 value. After 1998 Chongqing's population rapidly increases ten-fold to around 30 million. All of this made this unknown population source unusable.

	= [[China_Data_Center\|~~China_Data_Center~~]] =		= [[China_Data_Center\|China Data Center]] =

	The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.		The China Data Center database from the University of Michigan published population data from 1949 through 2003. This data was considered as a potential source to blend with the current population data from the [[China_Statistical_Yearbooks\|China Statistical Yearbooks]] to provide a longer historical time series. However, the two series could not be blended because the data from 1995 through 2003, where the two series had overlap, did not match.