Interactive JS plotter data list

Some more news and information about the Moyhu interactive plotter. The main content of the post is a listing of the data, with links. But first some discussion of versions and some updates on progress.

I have reinstated in V2 the ability to copy a URL which will reinstate the plot as you see it. This is intended for linking. There are minor limitations - it won't pass on user data, and it won't regenerate vectors made with the Calc box.



This got me thinking about version stability. If people are going to store links, I need to ensure that the code will still work if I add more data, for example. So my plan now is this. Versions will appear in blog posts, and I'll then leave them alone except for bug fixes. If you copy a link from such a site, it will refer back to that post, and should work indefinitely.

I'll keep the latest version of the plotter on a page. You can see the pages listed top right. I might add data there, and not post a new version for a while. It will allow you to copy URL's which will refer to that page but I won't guarantee that they will work in exactly the same way long into the future. For that, you should go to the most recent blog post version.

Data listing

The general way to get documentation in the plotter is to Ctrl-Click on any active button. That is, click with the Ctrl key depressed. On the Mac, I believe the Command key has similar effect. The information appears bottom right (green window) or on a separate tab if you have checked the New Window button.

If the button connects with data, you'll get info about the data. The buttons next to the selection boxes give a general description for the datasets contained. If you have plotted a set, there will be an entry in the plot list with a checkbox to it's right. If you Ctrl-Click that, the info window (bottom right) will show specific info, usually a link to source and another to an info page on the web.

Below is a listing of that information for each of the data sets that you can plot. The red headings below are the names of the selection boxes - then follow the contents.

	Hadcrut
1	HADCRUT 3	HADCRUT 3 Global Land and Ocean Index Source More information
2	HADCRUT 4 Globe	HADCRUT 4 Globe Source More Info
3	HADCRUT 4 NH	HADCRUT 4 NH Source More Info
4	HADCRUT 4 SH	HADCRUT 4 SH Source More Info
5	HADCRUT 4 Trop	HADCRUT 4 Tropical Source More Info
6	Had 4 NH Nov-Feb	HADCRUT 4 NH Nov-Feb Source More Info
7	Had 4 NH Mar-May	HADCRUT 4 NH Mar-May Source More Info
8	Had 4 NH Jun-Aug	HADCRUT 4 NH Jun-Aug Source More Info
9	Had 4 NH Sep-Nov	HADCRUT 4 NH Sep=Nov Source More Info
10	Had 4 SH Nov-Feb	HADCRUT 4 SH Nov-Feb Source More Info
11	Had 4 SH Mar-May	HADCRUT 4 SH Mar-May Source More Info
12	Had 4 SH Jun-Aug	HADCRUT 4 SH Jun-Aug Source More Info
13	Had 4 SH Sep-Nov	HADCRUT 4 SH Sep-Nov Source More Info
14	CRUTEM3	CRUTEM 3 Global Land Only Source More information
15	HAD NH	HADCRUT3 NH mean Source More information
16	HAD SH	HADCRUT3 SH mean Source More information
	GISS
17	GISS	GISS Global Land and Ocean Source More information
18	GISS Ts	GISS Met Stations (Land Only) Source More information
19	ConUS	Annual Temp Anomaly Lower 48 USA Source More information
20	Arctic	Annual Temp Anomaly Arctic 64-90°N Source More information
21	NH Temp	Annual Temp Anomaly NH Temp 24-64°N Source More information
22	Tropic	Annual Temp Anomaly Equator -24-24°N Source More information
23	SH Temp	Annual Temp Anomaly SH Temp 24-64°S Source More information
24	Antarctic	Annual Temp Anomaly Antarctic 64-90°S Source More information
	NOAA
25	NOAA Glob	NOAA Glob Land/Ocean Source More information
26	NOAA NH Land/Ocean	NOAA NH Land/Ocean Source More information
27	NOAA SH Land/Ocean	NOAA SH Land/Ocean Source More information
28	NOAA Glob Land	NOAA Glob Land Source More information
29	NOAA NH Land	NOAA NH Land Source More information
30	NOAA SH Land	NOAA SH Land Source More information
	Satellite Temp
31	UAH	UAH Lower Troposphere Source
32	MSU-RSS	MSU-RSS Lower Troposphere Source More Info
33	UAH Globe	UAH Globe Source More Info
34	UAH All Land	UAH All Land Source More Info
35	UAH All Ocean	UAH All Ocean Source More Info
36	UAH NH All	UAH NH All Source More Info
37	UAH NH Land	UAH NH Land Source More Info
38	UAH NH Ocean	UAH NH Ocean Source More Info
39	UAH SH All	UAH SH All Source More Info
40	UAH SH Land	UAH SH Land Source More Info
41	UAH SH Ocean	UAH SH Ocean Source More Info
42	UAH Tropics	UAH Tropics Source More Info
43	UAH TropicLand	UAH TropicLand Source More Info
44	UAH TropicOcean	UAH TropicOcean Source More Info
45	UAH NH ExtraTrop	UAH NH ExtraTrop Source More Info
46	UAH NHExtr Land	UAH NHExtr Land Source More Info
47	UAH NHExtr Ocean	UAH NHExtr Ocean Source More Info
48	UAH SH ExtraTrop	UAH SH ExtraTrop Source More Info
49	UAH SHExtr Land	UAH SHExtr Land Source More Info
50	UAH SHExtr Ocean	UAH SHExtr Ocean Source More Info
51	UAH NPolar All	UAH NPolar All Source More Info
52	UAH NPolar Land	UAH NPolar Land Source More Info
53	UAH NPolar Ocean	UAH NPolar Ocean Source More Info
54	UAH SPolar All	UAH SPolar All Source More Info
55	UAH SPolar Land	UAH SPolar Land Source More Info
56	UAH SPolar Ocean	UAH SPolar Ocean Source More Info
57	UAH USA48	UAH USA48 Source More Info
	Misc Temp
58	BEST	BEST Land Only Source More information
59	TOS Model	Source More information
60	Foster/Rahm GISS	Foster&Rahmstorf GISS land/ocean modified for exogenous effects Source More information
61	Foster/Rahm NCDC	Foster&Rahmstorf NCDC land/ocean modified for exogenous effects Source More information
62	Foster/Rahm CRU	Foster&Rahmstorf CRU land/ocean modified for exogenous effects Source More information
63	Foster/Rahm RSS	Foster&Rahmstorf RSS land/ocean modified for exogenous effects Source More information
64	Foster/Rahm UAH	Foster&Rahmstorf UAH land/ocean modified for exogenous effects Source More information
	SST/Ocean/Oscillation
65	HADSST3	HADSST3 Global Sea Surface Temperature Source More information
66	HADSST2	HADSST2 Global Sea Surface Temperature Source More information
67	HADiSST	HADISST Global Sea Ice and Sea Surface Temperature Source More information
68	NOAA Glob Ocean	NOAA Glob Ocean Source More information
69	NOAA NH Ocean	NOAA NH Ocean Source More information
70	NOAA SH Ocean	NOAA SH Ocean Source More information
71	OHC 0-700m	Global Ocean Heat Content 0-700m 10^22J Source More Information
72	UEA SOI	Southern Oscillation Index (UEA) Source More Info
73	AMO	AMO Reconstruction (Mann 2009b) Source More Information
74	PDO	PDO Reconstruction (Mann 2009b) Source More Information
75	JISAO AAO	Southern Oscillation Index (JISAO) Source More Info
76	JISAO NAM	Northern Annular Mode (JISAO) Source More Info
77	JISAO ENSO	ENSO (JISAO) Note that ENSO has short term variation and annual averaging smooths it a lot. Some peaks are lost. Source More Info
	Giss Forcings
78	All	GISS Model E forcings Global mean net Source More information
79	W-M GHG	GISS Model E forcings Well-Mixed GG Source More information
80	Ozone	GISS Model E forcings Ozone Source More information
81	StratH2O	GISS Model E forcings Stratospheric water Source More information
82	Solar	GISS Model E forcings Solar Irradiance Source More information
83	LandUse	GISS Model E forcings Land Use Source More information
84	SnowAlb	GISS Model E forcings Snow Albedo Source More information
85	StratAmer	GISS Model E forcings Stratospheric Aerosols Source More information
86	BC	GISS Model E forcings Black Carbon Source More information
87	Refl Are	GISS Model E forcings Reflectic Trop Aerosols Source More information
88	AIE	GISS Model E forcings Aerosol Indirect Effect Source More information
	GHG/Solar/Emissions
89	MLO CO2	Mauna Loa CO2 Source More Information
90	C13/C12 MLO	Mauna Loa δC13 Source More Info
91	C13 Signature	Global Stable Carbon Isotopic Signature Source More Information
92	GISS CO2	GISS CO2 Source More Info
93	Nitrous Oxide	Nitrous Oxide Source More Info
94	Methane	Methane Source More Info
95	TSI Recon	TSI Reconstruction Dora Source More Information
96	SIDC Sunspots	SIDC Yearly Sunspot Number Source More Info
97	FF emissions	Total carbon emissions from fossil fuels million metric tons of C Source More Info
98	FF Gas	carbon emissions from gas fuel consumption Source More Info
99	FF Liquid	carbon emissions from liquid fuel consumption Source More Info
100	FF Solid	carbon emissions from solid fuel consumption Source More Info
101	From Cement	carbon emissions from cement production Source More Info
102	Flaring	carbon emissions from gas flaring Source More Info
103	FF Per Cap	Per capita carbon emissions metric tons of carbon after 1949 only Source More Info
	TempLS
104	TempLS	TempLS Global Land and Ocean Source
105	TempLS GHCN 3 HSST2	TempLS GHCN 3 with HadSST2 More Info
106	TempLS CRUT 3 HSST2	TempLS CRUTEM 3 with HadSST2 More Info
107	TempLS GHCN 3	TempLS GHCN 3 Land Only More Info
108	TempLS CRUT 3	TempLS CRUTEM 3 Land Only More Info
109	TempLS GHCN 3 HAD3	TempLS GHCN 3 with HADSST3 More Info
110	TempLS CRUT 3 HSST3	TempLS CRUTEM 3 with HadSST3 More Info
	NCEP
111	NCEP-PW	Precipitable Water Source More Information
112	OLR	Outgoing Longwave Radiation Source More Information
113	NCEP-MEI	NCEP Multivariate ENSO Index Note that ENSO has short term variation and annual averaging smooths it a lot. Source More Info
114	NCEP-NAO	NCEP Nprth Atlantic Oscillation Source More Info
115	NCEP-NINO3	NCEP East Central Tropical Pacific SST Source
116	NCEP-ONI	NCEP Oceanic Nino Index Source
117	NCEP-SOI	NCEP Southern Oscillation Index Source More Info Units, 10*t-stat
118	Surf SH	Specific Humidity 1000Mb Source More Information
119	NCEP-SH850	Specific Humidity 850Mb Source More Information
120	NCEP-SH700	Specific Humidity 700Mb Source More Information
121	NCEP-SH600	Specific Humidity 600Mb Source More Information
122	NCEP-SH500	Specific Humidity 500Mb Source More Information
123	NCEP-SH400	Specific Humidity 400Mb Source More Information
124	NCEP-SH300	Specific Humidity 300Mb Source More Information

Interactive JS plotter Ver 2

Time for the next version of the interactive Javascript plotter. A few new capabilities, and some limitations removed.


The major new things are:

• A new layout. The data now sits in selection boxes, so I can include mich more of it. It does mean two clicks instead of one.
• A new multiple regression capability, which I think is quite powerful. You can use any of a number of calculated functions, or any data vectors as regressors. For example you could regress temperatures against various forcings.
• To complement this, a calculation capability - you can create and plot linear combinations (eg differences) of data vectors.
• An image can be used as background. This is useful for superimposing plots on published graphs (as in the Hansen predictions post).
• A user input capability. You can input your own images, or your own data.
• New windows for the markers for the plotted curves and their axes. This removes the limitation on how many you can have.
• More smoothing options

One thing that doesn't currently work is the ability to provide a web address that would regenerate the current state. This is because of the greater number of state variables. But I'm working on it. Update: it works. See new post.


The new data consists mainly of more complete collections of things like the regional data of GISS and UAH, and more NCEP data. And HADCRUT 4 is included. But there's room for more - suggestions welcome.


Here's the plotter - details below.

GISS Temp for March 2012 - comparison

TempLS showed a rise in global mean anomaly in March, 2012, from 0.19 °C to 0.293 °C. GISS showed a somewhat smaller rise, from 0.4 °C to 0.46 °C. The satellite indices showed rises larger than TempLS. Time series graphs are shown here

As usual, I compared the previously posted TempLS distribution to the GISS plot. Here is GISS:



And here is the previous TempLS spherical harmonics plot:

There is a disagreement over the Phillipines, where I get a cold spot and GISS doesn't. Otherwise they match well.
.

Previous Months

February
January
December
November
October
September
August

More data and plots

US temperature trends.

These are being discussed again. WUWT has rediscovered the NOAA analysis of USHCN adjustments to ConUS (lower 48 states) temperatures. They have inflated the original Fahrenheit adjustment trends restated in Celsius to make their argument. It's accpmpanied by a recent analysis by Roy Spencer of ISH data, which he has assembled into an index for ConUS, and finds that the trend 1973-present is small. But his figure includes his own adjustment for population density, and comes out to 0.013°C/decade. This he compares to USHCN at 0.245°C/decade, and attributes the difference to USHCN adjustment. CRUtem 3, which doesn't make the same adjustments, gets a trend of 0.198°C/decade.

It's unfortunate that Roy doesn't seem to give any trends from ISH that aren't subject to his population density adjustment, because then we could compare like with like. However, I will look at the GHCN unadjusted data for ConUS. This is a real test of whether the WUWT (and RS) claim that the trend is due entirely to adjustment is justified. It isn't much of a test if you strike their adjustments and then introduce a big new one.

I actually looked at ConUS with an early version of TempLS here. I looked at the period 1978-2009, and got a trend of 0.255°C/decade. This was using GHCN v2 min/max mean monthly data, with weighted regression using 5x5° cells. I thought I would update this calc, and for the period used by Roy. With TempLS V2.2, GHCN V3 V2 data and basically the same weighting, but with a period 1973-2011, I got a trend of 0.161 °C/decade. A bit less than CRUTem 3, but clearly there is trend in the unadjusted data too.

Along the way, I discovered a trick question. What is the easternmost US GHCN Met station?

The answer is Shemya AFB in the Aleutians, Longitude 174° East. That did trick me - in TempLS you provide logical statements to specify subsets, and I thought for ConUS requiring country code 425 (US) and east of Long 125W would do it. So Shemya, and another station at Attu, got included. There weren't many readings, and I don't think they changed the trend by much.I've fixed it now.

Station distribution bias

Anyway at WUWT Willis Eschenbach asked what precautions I had taken to avoid E coast bias. Probably the first thing to say is that GHCN has taken precautions. They have been criticised for pruning their list of stations but one thing that has been achieved is a reasonable uniformity. Here's a map of the stations reporting in 2011, and also all stations reporting at some point since 1972:

The distribution isn't that uneven. However, Ver 2.2 has some capabilities in mesh-based weighting. I was experimenting with those in Antarctica, and so I saw a chance to try them out here.

Weighting

The first thing I should say is that I haven't generally found that messing with weighting schemes changes average trends a lot. I should emphasise that the weighting scheme doesn't change the data, only the way it is included. Reweighting one station relative to another only has a big effect if they are very different. And of course, the changes tend to balance out in the average.

The purpose of weighting is essentially to form a sum which is a good approximation to a space integral. This has the appropriate physical significance, and also gives a rational basis for saying that bias due to clustering of stations has been overcome.

The best way I have found to use meshes is to surround each node of the mesh (which is done for every month, so the nodes are the stations reporting in the month) by the area formed from the adjacent portions of the triangles marked out by the medians and the edge bisectors. The preferred method is Voronoi, which forms the in-centres and the perpendicular bisectors. But here we're only trying to associate with each node an area for weighting purposes, so it isn't critical to have the areas exactly demarcated by closest neighborhood, as long as they are close and unique. And this scheme is a lot faster, which is important when you need a new tesselation every month over 40 years.

Convexity

I generate the meshes using R's convhull function. I use the 3D version, which means that I find the hull of the curved area (US). There is a back mesh, which is fairly easy to get rid of because the normals face the other way. But for a country shape, it incorporates bays etc with the land area.

For Antarctica I had trouble with the Weddell Sea and used a scheme for carving part of it out. This time I tried a new scheme which gets rid of the back mesh as well. I introduce a ring of new points (before meshing) which form a ring outside the stations. The idea is that if you ran a string around the surrounding nodes, it would be clear of any real stations. Then after having meshed the larger area, I eliminate the extra nodes and any triangles entailed. That tends to strip down to the real country outline. It's worth reminding that TempLS doesn't actually know about borders - it only has the location of the selected stations.

Meshes and weights

So here is the result. I'm showing the mesh in the background and weights proportional to the area of the circles around each station reporting in a particular month.

You can see that stations in sparser areas are upweighted according to the area they are taken to represent.

Trends

With the most recent mesh as shown in the diagram, I found that the trend using unadjusted GHCN monthly data for ConUS stations was 0.167°C/decade from 1973 to 2011. This is very similar to the cell-weighted figure (0.161), somewhat less than CRUTEM 3 (0.198) and less again than USHCN (0.245). Notwithstanding, I believe that the USHCN adjustments are justified, and theirs is the preferred figure. But is certainly isn't true that the adjustments are responsible for the uptrend.

More on adjustments

At WUWT Geoff Sherrington made the predictable objection that GHCN unadjusted data has been tampered with by the met stations. I've seen this often, but never with evidence.

In fact the original GHCN (mid 90's) was compiled direct from the records, to the extent that they preserved the various fragments from different sources. They then distributed that on CD, to many recipients.

In more recent times, I have never seen any indication that GHCN unadjusted records have been adjusted. There are occasional records removed when errors are found. Others come in late and are included. But they say that they don't modify records except on receipt of an amended CLIMat form from the Met supplier, and that seems to be true. Since the mid 90's these forms have been used exclusively, and you can inspect them here.

March 2012 temperatures up 0.1°C

The TempLS analysis, based on GHCNV3 land temperatures and the ERSST sea temps, showed a monthly average of 0.29°C, up from 0.19 °C in February. This is in line with satellite LT trends, though a more modest rise. There are more details at the latest temperature data page.

Below is the graph (lat/lon) of temperature distribution for March. The big US hotspot is very clear





This is done with the GISS colors and temperature intervals, and as usual I'll post a comparison when GISS comes out.

And here, from the data page, is the plot of the major indices for the last four months: