Friday, October 11, 2024

When regression doesn't work - Florida hurricanes

Firstly an apology - no TempLS yet for September. The reason is floods in Asheville, where the NOAA GHCN data comes from (in better times).

I'm writing about a post by Roy Spencer on the statistics of major hurricanes landfalling in Florida. His data comes from this Wiki table. He does a plot of intensity of major hurricanes against time:


He goes through the regression arithmetic (without error) to yield the flat line shown. So no trend? This exciting result is already doing the rounds.

The problem is one of censored data. Regression allows you to have data y with irregular spacing in t, on the assumption that there is a linear model
y=a*t+b+ε
where a and b are parameters that you estimate by fitting, and ε is a set of random residuals with mean zero (you can also estimate the sd). Put another way, the assumption is that missing data is statistically similar to the data sampled.

But here the missing years are not like that. We don't know the numbers (they were below Wiki's cut-off) but we know they were less than 100. That is what censored data means. And that just doesn't fit with the regression model.

You can see this with a simple case. Suppose we had just the 1935 hurricane, at 160 mph, and the 1992 one at 145 mph. Regression would give a down trend. But then you include the 1933 hurricane at 110. That is another big hurricane back then, so it should lower the trend further, no? No! The regression effectively averages the two to 135 mph, so now there is an uptrend. The reason is that the first regression assumed the 1933 value would be about 160. When it finds out that it is much lower, the trend goes up. And if it found out that 1934 was even lower, the trend would go up even further. And of course we do know that 1934 was less than 100.

This might seem like an artefact of too few data. So let's see it played out on a larger scale. Suppose in every year from 1906 to 1955, when there wasn't a major hurricane, we add one with strength 100 mph. That has to mean that the past was windier, right? And the trend is more negative. But no, the trend goes from Roy's -0.002 mph/year to 0.127 mph/year. Here is the plot, with trend and points after the strengthening of early hurricanes in blue:



So what is the right thing to do? I'm not an expert in censored data, so I don't know. But I do know this won't work. You can see intuitively that in the last 34 years, there have been 5 hurricanes greater than 118. There were only 4 in the previous 90.  That does indicate strengthening.

Roy did a second regression, on numbers of major hurricanes



This doen't have the same objection, because of the binning into decades. There are no missing data (except in the last decade). Years that had no major hurricanes were correctly assigned value zero in the binning. And yes, the trend is up. So this plot is not the one that is circulating.

Thursday, September 12, 2024

GISS August global temperature up by 0.09°C from July.

The GISS V4 land/ocean temperature anomaly was 1.3°C in August, up from 1.21°C in July. This rise was similar to the 0.065°C rise reported here for TempLS.

As with TempLS, August was the warmest August in the record - next was 1.19°C in 2023.

As usual here, I will compare the GISS and earlier TempLS plots below the jump.

Sunday, September 8, 2024

August global surface TempLS up 0.065°C from July, warmest August in record.

The TempLS FEM anomaly (1961-90 base) was 1.161°C in August, up from 1.096°C in July. It was, by a small margin, the warmest August in the record, ahead of 1.108°C in 2023. That makes 15 record months in a row, which is an amazing run.

Here is the corresponding stacked graph, showing how much hotter recent months have been:


Here is the temperature map, using the FEM-based map of anomalies. Use the arrows to see different 2D projections.






As always, the 3D globe map gives better detail. There are more graphs and a station map in the ongoing report which is updated daily.

Sunday, August 11, 2024

GISS July global temperature down by 0.04°C from June.

The GISS V4 land/ocean temperature anomaly was 1.21°C in July, down from 1.25°C in June. This fall contrasts with the tie reported here for TempLS.

As with TempLS, July was by a whisker the warmest July in the record - next was 1.19°C in 2023.

As usual here, I will compare the GISS and earlier TempLS plots below the jump.

Thursday, August 8, 2024

July global surface TempLS up 0.001°C from June, warmest July in record.

The TempLS FEM anomaly (1961-90 base) was 1.084°C in July, up from 1.083°C in June. This of course is a virtual tie, and could be reversed with further data It was, by a whisker, the warmest July in the record, ahead of 1.072°C in 2023. That makes 14 record months in a row.

Here is the corresponding stacked graph, showing how much hotter recent months have been:


Here is the temperature map, using the FEM-based map of anomalies. Use the arrows to see different 2D projections.






As always, the 3D globe map gives better detail. There are more graphs and a station map in the ongoing report which is updated daily.

Thursday, July 11, 2024

GISS June global temperature up by 0.05°C from May.

The GISS V4 land/ocean temperature anomaly was 1.21°C in June, up from 1.16°C in May. This rise is similar to the 0.03°C reported here for TempLS.

As with TempLS, June was the warmest June in the record - next was 1.08°C in 2023.

As usual here, I will compare the GISS and earlier TempLS plots below the jump.

Monday, July 8, 2024

June global surface TempLSup 0.030°C from May, warmest June in record.

The TempLS FEM anomaly (1961-90 base) was 1.059°C in June, up from 1.029°C in May. It was the warmest June in the record, ahead of 0.95°C in 2023. The NCEP/NCAR reanalysis base index fell by 0.013°C.

That makes 13 record months in a row; and June 2024 is even close to July 2023, so it may not be the last of this run. It is looking even more likely that 2024 will be a record warm year, well ahead even of 2023.

Here is the corresponding stacked graph, showing how much hotter recent months have been:


Here is the temperature map, using the FEM-based map of anomalies. Use the arrows to see different 2D projections.






As always, the 3D globe map gives better detail. There are more graphs and a station map in the ongoing report which is updated daily.