tag:blogger.com,1999:blog-8524070301101240472.post3978451323313360423..comments2023-09-28T08:13:11.489-07:00Comments on Only In It For The Gold: How do we know climate models are useful?Michael Tobishttp://www.blogger.com/profile/08229460438349093944noreply@blogger.comBlogger7125tag:blogger.com,1999:blog-8524070301101240472.post-19225732425842289042007-07-14T15:33:00.000-07:002007-07-14T15:33:00.000-07:00This is getting a bit tangential but I'm baffled b...This is getting a bit tangential but I'm baffled by the escrow bit. If your GCM makes a prediction, why do you need to keep the code? All you care about is keeping the prediction and later verifying it. There is no need for subsequent model runs.William M. Connolleyhttps://www.blogger.com/profile/05836299130680534926noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-81874054114228134112007-07-14T08:35:00.000-07:002007-07-14T08:35:00.000-07:00Thanks Tony."science showing global warming to be ...Thanks Tony.<BR/><BR/>"science showing global warming to be unequivocal" is not really a well-defined statement.<BR/><BR/>"Global warming" is literally, to a scientist, an assertion that a planet is warming on some time scale. There's so little doubt of that on earth now that it isn't worth considering, though it's probably excessive to say anything in earth science is "unequivocal". <BR/><BR/>The phrase "global warming" is slippery. I try to avoid it. I can think of at least five meanings and I think the obfuscators casually slip from one to another to confuse the conversation.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-65510021319134286682007-07-13T22:53:00.000-07:002007-07-13T22:53:00.000-07:00Thanks for your response. I hadn't realised they w...Thanks for your response. I hadn't realised they were making essentially an argument from authority. It's so hard to keep up with all the dust they keep throwing in our faces!<BR/><BR/>I just got off a long Skype call with my girlfriend in Tokyo who was convinced by a newspaper article she read that there was no science showing global warming to be unequivocal. Sigh.<BR/><BR/>Keep up the good work. In case you haven't heard this recently, what you established researchers in the field are doing is invaluable for those of us passionate about the topic but without the education.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-2914550606496459532007-07-13T21:41:00.000-07:002007-07-13T21:41:00.000-07:00So the person behind forecastingprinciples.com acc...So the person behind forecastingprinciples.com accuses climate science of being unaware of forecastingprinciples.com . To this accusation I for one plead guilty. <BR/><BR/>He isn't moving the goalposts, he is inventing the game.<BR/><BR/>It is certainly the case that the sorts of forecasts he dwells on on his site are very difficult. <BR/><BR/><EM> 1. Can you give me examples of different types of forecasting problems?<BR/><BR/> Sure. Forecasting problems can be posed as questions. Here are some examples. How many babies will be born in Pittsburgh, PA in each of the next five years? Will the incumbent leader be elected for a second term (see Political Forecasting)? Will a 3.5% pay offer avert the threatened strike (see Conflict Forecasting)? How much inventory should we aim to hold at the end of this month for each of 532 items? Will the economy continue to grow at a rate of at least 2% per annum over the next three years? Taking account of technical matters and concern among some communities, how long will it take to complete the planned pipeline? In which areas should policing efforts be concentrated in order to have the greatest effect on property crime (see Crime Forecasting)? Which will be the most prevalent diseases in the U.K. ten years from now (see Health Forecasting)?</EM><BR/><BR/>On the other hand, a forecast of the position of Jupiter in the sky exactly 50,000 years hence is quite feasible.<BR/><BR/>Climate physics is more constrained than social dynamics and less constrained than the orbits of the planets. So we can get more than 5 years and less than 50,000. <BR/><BR/>Beyond that you have to get into detail. <BR/><BR/>These guys are promulgating purported universal principles on the basis of an argument from authority, when as far as I can tell the only basis for their authority is having registered "forecastingprinciples.com". <BR/><BR/>Well, I registered 3planes.com some years ago. This means that anyone claiming to be three-dimensional will have to pass 83 criteria identified by me.<BR/><BR/>I see the drumbeat of the denialist camp is in action, since David Duff referred to this silly thing in another thread. <BR/><BR/>It's noise. <BR/><BR/>Let's talk about what we can know about climate, what we already know, what we stand to learn, and what we'll probably never figure out. Let's base it on geochemistry and geophysics please, and not on the lousy record of predictions of self-declared experts in public policy or economics.<BR/><BR/>Science really is different.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-56594649158975905012007-07-13T21:18:00.000-07:002007-07-13T21:18:00.000-07:00A very respectful and valuable discussion, as alwa...A very respectful and valuable discussion, as always. IANACS, but I like to think I'm as informed as an educated citizen needs to be to make up his mind on climate change.<BR/><BR/>However, one sceptic argument that makes sense to me is the one about models. To hear them say it, climate scientists aren't up with the latest modelling techniques since they don't have any formal modelling training. Hence (so the argument goes) the climate models used by most of the papers in the IPCC review are simplistic.<BR/><BR/>One of the latest attacks (<A HREF="http://www.forecastingprinciples.com/Public_Policy/WarmAudit31.pdf" REL="nofollow">here</A>) is upcoming in <I>Energy and Environment</I>.)<BR/><BR/>My question is, how up-to-date are the models used? Do they meet all the 89 modelling principles referred to in the E&E paper (or are the authors moving the goalposts)? The E&E paper seems suspicious but I can't put my finger on it.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-24086331374683573272007-07-13T13:22:00.000-07:002007-07-13T13:22:00.000-07:00As usual with a good conversation, many possible t...As usual with a good conversation, many possible threads started here. It may not be possible to chase all of them down...<BR/><BR/>Regarding "survivor bias" I understand your point but that doesn't mean it's true. I ask you to provide comparable examples of comparable predictions of the same class of models that failed. <BR/><BR/>The assertion is that some first order behaviors of the system were successfully predicted by a cross-model consensus. I elaborate by asserting that I know of no counterexamples. Things happenned the way my profs 15 years ago said they would. I consider this a validation. <BR/><BR/>This business about escrow is a bit crazy. Untar CCM2 and run it with Hansen's middle scenario for yourself. The models may be obscure but they aren't secret.<BR/><BR/>===<BR/><BR/>The "burden of proof" question is one I took up over a decade ago on sci.environment. I don't think my position on it has changed. I think it's fundamentally a misguided question.<BR/><BR/>In political circles we see each side with an essentially airtight argument that the burden of proof goes to the other side. One side calls it "precautionary" and the other "conservative". Essentially these amount to exactly the same impulse applied to different things. <BR/><BR/>I was accused on a leftist blog recently of being "excessively reasonable" (apparently because I don't want to send the board of directors of Peabody Coal to the Gulag), but I'm afraid I have to stick to my nambly flambly middle of the roadism here. <BR/><BR/>So how's this for a cowardly difference-splitting position? <EM>Both sides are offering completely useless formulations with extremely dangerous ramifications, and only a pragmatic approach has any promise.</EM><BR/><BR/>More to follow. <BR/><BR/>Do stay in touch. (You never call. You never write...)Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-8111412559463624362007-07-13T12:26:00.000-07:002007-07-13T12:26:00.000-07:00Thanks for the (as usual) well-informed and intere...Thanks for the (as usual) well-informed and interesting commentary.<BR/><BR/>I think that reactions to both of the points that I raised and to which you responded depend on three things: (1) what elements of the ‘scientific consensus” do we care about being right or wrong?, (2) where is the burden of proof?, and (3) how self-contained should a presentation like hers be? I implicitly, though I am happy to be explicit about it, assumed that (1) the only question I care about is our ability to predict the climate impacts of various human forcings, (2) the burden of proof lays with those who claim to be able to predict the attributable impact of a climate forcing 50 – 200 years from now, and (3) that when somebody titles a presentation “The Scientific Consensus on Climate Change: How Do We Know We’re Not wrong?” the assumption is that (at the level of abstraction relevant to the argument) the presentation will contain the information required to evaluate the claims being made.<BR/><BR/>Under these three assumptions, my first comment can be boiled down (in less snarky language) to the point that she has provided incomplete evidence on this point to evaluate “how we know we’re not wrong”. We would have to be presented a relatively complete list of the predictions made by the relevant science (as it was understood at the time of the predictions), and which were correct and which incorrect. Her slide demonstrates a classic case of survivor bias.<BR/><BR/>In terms of the second of my comments that you reference, I have often had to defend the AGW hypothesis from skeptics who will say something like: “there’s no warming trend over the last 5 years” (or five minutes, or whatever comes in handy to them). <BR/><BR/>Here’s an exchange for Planet Gore. Steven Milloy criticized me for accepting that more CO2 means the atmosphere gets hotter (as part of a much longer article), here Milloy said:<BR/>From a historical perspective, consider the relationship between carbon dioxide emissions and global temperature for the period 1940-1970. As atmospheric CO2 levels steadily increased during this period, global temperatures decreased, giving rise to the 1970s-era scare of an impending ice age. It’s also clear that, if there has been a relationship between atmospheric CO2 and global temperature since the 1970s, it’s not readily apparent. <BR/> <BR/>I respond by saying:<BR/>This is a type of argument that Milloy uses repeatedly in his piece. He identifies several decades or a geographic region, or the combination of both, for which there is no correlation between CO2 and some relevant outcome that would support the hypothesis that human activity is creating global warming, and acts as if this is a smoking gun that disproves the hypothesis. In technical terms, he is claiming that the hypothesis has failed a falsification test.<BR/>This is like saying “Look, I cut way down on fatty foods after the holidays and the level of plaque in my arteries did not noticeably decrease by April, therefore this theorized link between fat intake and arteriosclerosis can’t be correct”. The obvious problems with this supposed falsification test are that the theory calls for an effect that is (i) based on cumulative intake, (ii) manifests itself over a longer period than four months and (iii) is part of a complex system called he human body that is only partially understood. You would have to run the test over a much longer period and with more than one person and varying levels of fat intake to reliably test the theory. Similarly, observing that "hey we kept pumping a lot of CO2 into the air between 1940 and 1970 and temperatures didn't go up" does not falsify the hypothesis that CO2, all else equal, increases temperature over time. I’ll refer to this as the “localized fallacy” each time Milloy uses it in order not to have to repeat this argument.<BR/><BR/>I believe what I said to him. But you can’t have it both ways – if the hypothesis requires X years to falsify or fail to falsify, then you can’t pick individual data points that are consistent with your hypothesis and say ‘that this constitutes material evidence for it.<BR/><BR/><BR/>You can see the whole exchange here, if you’re really bored:<BR/><BR/>http://planetgore.nationalreview.com/post/?q=YjFiMDdiYzRmMjkzZGIyNjVjNjhkZDgzODMwYzU1ZTM=<BR/><BR/>http://planetgore.nationalreview.com/post/?q=ZTE3NTliYTA4YTUzNjkzMzg4NzIzYzg5YjJhMWY2NDA=<BR/><BR/><BR/>You raised a separate point about my assertion that the models have not been validated. I’ve written several articles that address this point and have had a long online dialogue with Gavin at RealClimate about this. Here’s what I mean by validation: a GCM makes a prediction at time X for the temperature at some later time Y; the GCM and operational codes are escrowed at that time; when time Y rolls around the actual set of data for all required model inputs in entered and operational scripts are executed by a party that did not build the model and this result is compared to actual measured temperature at time Y. A series of validation exercises like this is used to create a distribution of forecast error. I know of no published effort that has done this and validated that any GCM is capable of performing THE key advertised function: predict the temperature impact of various emissions scenarios on a multi-decadal timescale. There is a long, sorry history of predictive models in a variety of fields that seem to make sense, and perform well on hold-out samples, but fail in production. Further, almost all predictive modeling communities over-estimate their own accuracy.<BR/><BR/>Best,<BR/>Jim <BR/>(and yes, I am actually Jim Manzi, though I can’t see how to validate this claim – so to speak)Anonymousnoreply@blogger.com