tag:blogger.com,1999:blog-8524070301101240472.post643996410426064549..comments2023-09-28T08:13:11.489-07:00Comments on Only In It For The Gold: Pielke, Part of the ProblemMichael Tobishttp://www.blogger.com/profile/08229460438349093944noreply@blogger.comBlogger17125tag:blogger.com,1999:blog-8524070301101240472.post-49567897214186743112008-08-27T19:11:00.000-07:002008-08-27T19:11:00.000-07:00Out in the non-net world I have said a lot of what...Out in the non-net world I have said a lot of what you said here, Michael. It's well-expressed.Marion Delgadohttps://www.blogger.com/profile/09493068399042656060noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-40413242355302889622008-08-26T08:18:00.000-07:002008-08-26T08:18:00.000-07:00Michael Tobis, John Mashey:The way I see it, part ...Michael Tobis, John Mashey:<BR/><BR/>The way I see it, part of the problem is that "research" and "development" are mushed together in the case of climate modelling. Is there a way to separate out the development of new kinds of climate models ("research") with the running of these climate models to produce results with practical usage (which more properly falls into "development")?bi -- International Journal of Inactivismhttps://www.blogger.com/profile/03030282249404084578noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-45786085117097412092008-08-24T22:02:00.000-07:002008-08-24T22:02:00.000-07:00For any software I've ever seen, there's a "natura...For any software I've ever seen, there's a "natural" release timing that is short enough to be responsive and far enough apart to actually get some work done. I've seen several years apart for major releases of commercial software (like SAS, which had major correctness/QA issues across platforms).<BR/><BR/>Is there a proper release interval for climate models/IPCC?John Masheyhttps://www.blogger.com/profile/17786354229618237133noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-22262083879147354582008-08-24T15:27:00.000-07:002008-08-24T15:27:00.000-07:00Time to start a technical thread, methinks.Google ...Time to start a technical thread, methinks.<BR/><BR/>Google has "Earth System Modeling Framework" as the first hit for "ESMF" for me, though.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-40066932481332739692008-08-24T14:56:00.000-07:002008-08-24T14:56:00.000-07:00ESMF?ESMF?David B. Bensonhttps://www.blogger.com/profile/02917182411282836875noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-90375893265548964742008-08-24T14:20:00.000-07:002008-08-24T14:20:00.000-07:00John, I'm all for incremental releases and triage ...John, I'm all for incremental releases and triage of features in most kinds of software. <BR/><BR/>Alas, the whole nature of a climate model is tight coupling. The whole advance in software design methodology is loose coupling. <BR/><BR/>It would make for a damned interesting computer science problem if computer scientists were foolish enough to take on how to properly decouple the code and built and test large families of legitimate models. The efforts to do so (and here I refer primarily to ESMF) seem to be massive train wrecks in progress, largely because of politically expedient and technically ludicrous design decisions made in early phases. <BR/><BR/>(I would like to take it on myself, in the right company and under the right circumstances. That isn't to say it would be easy or low risk.)<BR/><BR/>The whole development environment is peculiar. Many lessons from other sectors don't apply directly.<BR/><BR/>Consider that the IPCC requires two years of RUNS as the end product. The software isn't the focus of the process; it's the output of the software that is the focus. (And of course nobody has ever heard of Hamming's law in these circles; the purpose of the exercise is numbers.)<BR/><BR/>This means that forty percent of the time at a minimum development is frozen. Plus the runs have to be documented in published literature, which leads to the odd dance that the McIntyreans have caught on to, of papers that will eventually be published being rushed into press to serve various institutional goals.<BR/><BR/>So now you are down to a 50% duty cycle. Much of this is, as you point out, about new architectures. <BR/><BR/>In this next round, a great deal of effort has to be put into "compliance" with ESMF standards, which would be one thing if they started from a clean slate but is another thing entirely when it's jammed into extant codes. <BR/><BR/>Working backwards from that there is a lot of time that needs to be carved out for tuning and CGCM so it's even remotely stable for multicentury runs. (Is the result consequently overly stable? Hmmm.)<BR/><BR/>The end result is that the physics to be included in the next generation NCAR model targeted at the 2012 time frame is being finalized in the next few months. You may argue that this yields plenty of time to work on 2017, but of course nobody is doing that because the institutional momentum of climate research centers is so severely damaged as a result of the interest the work draws in political circles.<BR/><BR/>So NCAR's models have some qualitative resemblance to MS Office, with lots of features nobody uses bolted on, bizarre bugs, inadequate documentation, and little substantial improvement in utility or stability since the first functional releases. <BR/><BR/>I don't know as much about other modeling centers but I think the same pressures operate.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-47416154779407538562008-08-24T13:47:00.000-07:002008-08-24T13:47:00.000-07:00I'm of two minds about the effects of schedules on...I'm of two minds about the effects of schedules on simulation:<BR/><BR/>it's too bad if bad software engineering happens to try to make a date...<BR/><BR/> ... but on the other hand, having shipped / helped ship / managed the shipping of many software products, having predictable schedules like trains has merit.<BR/><BR/>At SGI, we went from "we'll ship a new OS whenever some new hardware comes and we have all the new features in" to:<BR/><BR/>"there will be a regular release every quarter, and if your stuff isn't ready, it will wait for the next train."John Masheyhttps://www.blogger.com/profile/17786354229618237133noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-72571877460998183602008-08-24T04:03:00.000-07:002008-08-24T04:03:00.000-07:00Michael Tobis:"The existing climate modeling insti...Michael Tobis:<BR/><BR/>"The existing climate modeling institutions do have turf interests in their climate centers, though. The state of science is not a thing of beauty."<BR/><BR/>I don't know much about the ins and outs of the climate science community, but how different is this from what's going on in the rest of the scientific community, nay, the rest of academia? To me it just looks like the normal rush to publish as soon as possible, period. (Unless there's some special status accorded to papers which are cited in an IPCC report, that is.)bi -- International Journal of Inactivismhttps://www.blogger.com/profile/03030282249404084578noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-44532622886903170272008-08-23T15:36:00.000-07:002008-08-23T15:36:00.000-07:00Dano, thanks for your response. I'm not exactly su...Dano, thanks for your response. I'm not exactly sure which part you wnat me to take up. I think the most interesting part is this:<BR/><BR/>Me:<BR/><BR/><EM>In demanding a formal process to justify the nontrivial changes in social structure and international relations required by the state of things, people resisting such changes have a solid point.</EM><BR/><BR/>Dano:<BR/><BR/><EM>Yes, because this would delay things further.<BR/><BR/>IOW: further processizing and bureaucratizing (odd that the anti-gummint types want more bureaucracy, no?) is a delaying tactic.</EM><BR/><BR/>Of course this is to some extent right. You will find strong support among denialists for the idea that the earth contrives to neatly cancel out global warming with albedo changes (as if this would mean there were no problem), and yet remarkably little support for launching the already built Triana/DISCOVR instrument that could put this idea to the test.<BR/><BR/>However, it is a mistake to assert either that all opposition to mitigation policy is unanimous. There are some people who simply want a reliable chain of evidence and who aren't convinced they are getting one.<BR/><BR/>So it's true; we have people eager to point out a problem who tend to be very reluctant to do anything about it. <BR/><BR/>At first blush, answer to them seems simple enough: pony up the funds and build the structures you would trust. Meanwhile, you'd best go with the best we can do now.<BR/><BR/>You can install your night vision camera later, but your car is on the foggy mountain road right now. If you don't slow down you won't have anything to attach your fancy new gizmo to later on.<BR/><BR/>There is no reason to deny that it would still be better if the fog were to lift a bit.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-71373693724568882462008-08-23T15:06:00.000-07:002008-08-23T15:06:00.000-07:00Frank, you have fallen into the denialist frame!Wh...Frank, you have fallen into the denialist frame!<BR/><BR/>When I say that the five year cycle "distorts the science" I do not mean that the five year cycle misrepresents the global mean temperature sensitivity, and certainly not that it introduces a bias in that quantity or similar results. (In fact, I suspect the prevailing bias is to understate risks, though I think the most likely outcome is on fairly solid ground.)<BR/><BR/>I do not think any further refinement of the climate prognosis will come from existing model strategies. Specifically, we need meaningful regional predictions, and we are a ling way from getting them, and the current setup is almost ideally contrived to prevent substantial progress.<BR/><BR/>Maybe it's a coincidence that the decline of significant progress in computational climatology coincides almost exactly with the emergence of the the IPCC process. I am starting to wonder, though.<BR/><BR/>This isn't to say it is possible to create a climate model comparable in fidelity to mid-1990s CGCMs which has small sensitivity. Of course nobody thinks that it is possible, or somebody would have done it. I think that is Frank Bi's point, and I completely agree.<BR/><BR/>I find it interesting that I could be read as making the opposite point.<BR/><BR/>The existing climate modeling institutions do have turf interests in their climate centers, though. The state of science is not a thing of beauty. <BR/><BR/>Would fixing it bother the denialists much? Probably not. Conspiracy theories can always be spun out of the thinnest of evidence. <BR/><BR/>I guess my point here is to acknowledge that while there are a lot of problems with the scientific community, prominent critics of existing climate science are as likely as anyone else to base their behavior on these distorting influences.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-91840986228254401532008-08-23T14:48:00.000-07:002008-08-23T14:48:00.000-07:00David, that seems to conflate two separate things....David, that seems to conflate two separate things. <BR/><BR/>I frankly believe that <B>all public sector computing should be on a 100% open source and open data stack, scientific software or otherwise</B>; some very narrow exceptions for security related work conceivably apply. (It definitely applies to voting machines, though. Many security experts also prefer open source for everything except the passwords.)<BR/><BR/>You won't find me defending people hiding their calculations. Alas, things don't work that way at present and there are plenty of people motivated to keep it that way for plenty of reasons.<BR/><BR/>I don't think the buck stops quite as clearly with Hansen as many people propose. It's not as if his job were actually to be chief of software QA.<BR/><BR/>Atmos found some funky aspects to some GISS data if I recall right. That doesn't mean he subscribes to a grand conspiracy hypothesis.<BR/><BR/>But all of this is entirely a red herring. The demand was for the community to stand up and be counted in their outrage about Mann et al, and that is just a bizarre idea. If you'd like to defend their position, do so. If you'd like to change the subject, give it a try. But please don't do the one under pretense of the other.Michael Tobishttps://www.blogger.com/profile/08229460438349093944noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-83145964568864311442008-08-23T11:47:00.000-07:002008-08-23T11:47:00.000-07:00Thank you Michael. Especially for these -"What, t...Thank you Michael. Especially for these -<BR/><BR/>"What, then, is the moral status of quibbling about tree rings when the radiative balance of the atmosphere is being forced at a rate without remote precedent in the entire history of mammals[?]"<BR/><BR/>and<BR/><BR/>"...by fertilizing the ground where others are happy to plant wild conspiracy theories, McIntyre and now Pielke do an enormous disservice."Anna Hayneshttps://www.blogger.com/profile/15176850465809297298noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-20748964032395428332008-08-23T06:26:00.000-07:002008-08-23T06:26:00.000-07:00"One wonders who is expected to "speak up" and whe..."One wonders who is expected to "speak up" and when."<BR/><BR/>Well, we could start with James Hansen when he is asked, politely, to provide the codes from which his adjusted figures are produced.<BR/><BR/>That would be a good start, I think!<BR/>David DuffAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-22224701413500573712008-08-22T22:52:00.000-07:002008-08-22T22:52:00.000-07:00Michael Tobis:"Since `getting the runs in time for...Michael Tobis:<BR/><BR/>"Since `getting the runs in time for IPCC' is the driving force of climate modeling these days, and this distorts the software engineering process, I can actually state confidently that there is some truth to the complaint."<BR/><BR/>I'm quite surprised you'll think that. The problem with this reasoning is, is there any reason why the `no global warming' folks can't also get their own climate model runs in time for inclusion in the next IPCC report? Does UAH's Roy Spencer not have enough resources at his disposal to do his own climate modelling? So this accusation amounts to saying that there's some sort of over-arching Warmist Conspiracy in which editors of scientific journals purposely rush papers predicting global warming into print, and purposely delay or suppress papers which predict no global warming.<BR/><BR/>* * *<BR/><BR/>Interestingly, <I>Energy and Environment</I> has indeed been rushing garbage into print for the express purpose of attacking the IPCC -- see the `journal paper' titled "The IPCC Emission Scenarios: An Economic-Statistical Critique".<BR/><BR/>I'm quite confident that Pielke, instead of "speaking up" against this, will dodge and weave and find some flimsy pretext to avoid talking about it.bi -- International Journal of Inactivismhttps://www.blogger.com/profile/03030282249404084578noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-24812772451286515362008-08-22T15:41:00.000-07:002008-08-22T15:41:00.000-07:00NOt only stay in the ground, but lots of it needs ...NOt only stay in the ground, but lots of it needs to be put back in the ground.<BR/><BR/>About 500 GtC.David B. Bensonhttps://www.blogger.com/profile/02917182411282836875noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-26802921799609346252008-08-22T13:08:00.000-07:002008-08-22T13:08:00.000-07:00Maybe a bit O/T, but speaking of "accusations of s...Maybe a bit O/T, but speaking of "accusations of spectacular dishonesty"... Yale's Gary Yohe, a lead author of Lomberg's Copenhagen Consensus Project's principal climate paper says this today in The Guardian:<BR/><BR/><A HREF="http://www.guardian.co.uk/commentisfree/2008/aug/22/climatechange.carbonemissions" REL="nofollow">"I can say with certainty that Lomborg is misrepresenting our findings thanks to a highly selective memory.<BR/><BR/>Lomborg claims that our "bottom line is that benefits from global warming right now outweigh the costs" and that "[g]lobal warming will continue to be a net benefit until about 2070." This is a deliberate distortion of our conclusions...<BR/><BR/>... In short, we never advocated research into new technologies as a stand-alone way to fight climate change, nor did we accept Lomborg's dismissive attitude toward the threat climate change poses. <BR/><BR/>The negotiators in Copenhagen will need credible, accurately reported analyses upon which to base their discussions. This is not the time to deny the scope of the problem or belittle efforts to implement solutions. We need all options on the table. This was the message of the Copenhagen Consensus Challenge paper, and even a sceptical environmentalist should understand that."</A>tidalhttps://www.blogger.com/profile/08979480547719289608noreply@blogger.comtag:blogger.com,1999:blog-8524070301101240472.post-47482789071627274402008-08-22T12:49:00.000-07:002008-08-22T12:49:00.000-07:00Willis Eschenbach is a knob. I got into a long, lo...Willis Eschenbach is a knob. I got into a long, long series of comments with him on <B>C</B>horus, <B>A</B>men regarding future agricultural yields and ecological side effects. It all stemmed from him plotting a trend line for ag productivity and calling it good, and gosh, why didn't the moron agronomists think of this, geez scientists are stupid, they should be engineers like me look how smart I was to plot a trendline!!!! <BR/><BR/>After not being able to make him explain why he wasn't sharing this massive, Galileo-like agronomics breakthrough with the world, I finally opened it up for a bet, to anyone and everyone. Anyone submitting an agron manuscript using this technique and getting it past first cut got $100.00 from me - there was no limit on submissions and the potential for numerous journals to accept for review made it modestly lucrative indeed. <BR/><BR/>As was to be expected, all I got for a response was a bunch of excuses as to why no one could submit such a manuscript, all along the lines of 'I have to wash their hair for the next 6 months or so'. <BR/><BR/>----------<BR/><BR/><I>The tragedy is that these quibbles are inflated onto accusations of such spectacular dishonesty specifically in order to color the policy debate. </I><BR/><BR/>Not good enough, Michael. <BR/><BR/>Much better is:<BR/><BR/><I>The tragedy is that these molehills are inflated into accusations of such spectacularly high mountains of dishonesty specifically in order to color the policy debate. </I><BR/><BR/>or <BR/><BR/><I>The tragedy is that these few crumbs are trumpeted into descriptions of such spectacularly huge feasts specifically in order to color the policy debate. </I><BR/><BR/>etc. Must frame tactics properly. <BR/><BR/>----------<BR/><BR/><I>In demanding a formal process to justify the nontrivial changes in social structure and international relations required by the state of things, people resisting such changes have a solid point. </I><BR/><BR/>Yes, because this would delay things further. <BR/><BR/>IOW: further processizing and bureaucratizing (odd that the anti-gummint types want more bureaucracy, no?) is a delaying tactic. <BR/><BR/>----------<BR/><BR/><I>Bristlecone pines or not, the carbon has to stay in the ground. </I><BR/><BR/>- Say, Uncle Morty: DUIs or not, the bottle has to stay on the shelf. <BR/><BR/>- Cooking meth being dangerous or not, you have to stop doing crank - it's bad for you. <BR/><BR/>IOW: this is bad framing for addicts, Michael. The oil addicts (whether for cheap energy, easy lifestyle, or big profits) don't want to hear what you - or anybody - has to say if it means they can't have their parenthesized.<BR/><BR/>Best,<BR/><BR/>DDanohttps://www.blogger.com/profile/03709762632849004871noreply@blogger.com