tag:blogger.com,1999:blog-3722233.post111413638670488359..comments2024-03-18T17:27:11.613-05:00Comments on Computational Complexity: A Fine Line Between Prank and FraudLance Fortnowhttp://www.blogger.com/profile/06752030912874378610noreply@blogger.comBlogger32125tag:blogger.com,1999:blog-3722233.post-1114883133655904962005-04-30T12:45:00.000-05:002005-04-30T12:45:00.000-05:00Fraud implies some serious intent to "get away wit...Fraud implies some serious intent to "get away with something", to pass one thing off as another. Anyone who spent 2 minutes reading their paper would immediately realize that this isn�t a real paper. They might be confused regarding the intent, but they would know instantly and absolutely that the authors weren�t even trying to fool anyone into thinking that it was a real piece of science. The papers that SCIgen churns out are about as subtle as a Three Stooges film, and that�s not fraud, that�s parody. Parody is a crucial tool in the toolkit of those looking to expose shams and shallow thinking, and as such I think the students� actions were completely reasonable.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114424381029569322005-04-25T05:19:00.000-05:002005-04-25T05:19:00.000-05:00Aaronson said Gosh ... does the fact that people a...Aaronson said<BR/><BR/><I> Gosh ... does the fact that people apparently didn't get my joke argue for or against the point I was trying to make? </I><BR/><BR/>Dude, that was -way- too subtle. The only possible giveaway was the Galileo example, which only sparked a tenuous memory ("didn't Galilleo actually do that? or maybe Simplicio (or was it Stultio? or shoot was that by Hume?) To expose my own ignorance, who the heck is Blondlot or Wood?). The rest was reasonable enough to be taken seriously. As to the "foundation of trust" thingy, OK, that's off, but it just doesn't sound like you're kidding.<BR/><BR/>Oh... was that your point? Sorta like meta-joking? ;)Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114411413129968122005-04-25T01:43:00.000-05:002005-04-25T01:43:00.000-05:00Query to Lance Fortnow: Hope to see reply to this:...Query to Lance Fortnow: Hope to see reply to this: <BR/><BR/>Isn't it a good idea to submit the papers on archives and shouldn't the leading computer scientists like yourself promote it?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114295565323041272005-04-23T17:32:00.000-05:002005-04-23T17:32:00.000-05:00I think what the students did is not necessary to ...I think what the students did is not necessary to show the lack of standards of the conference. There is already an unofficial evaluation of conferences, and is well know that the SCI conferences rank pretty low. Mockery, on the other hand, brings only disadvantages for the field -- with the additional side effect that now the chance of having good things coming from these conferences will become close to zero.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114275558054099092005-04-23T11:59:00.000-05:002005-04-23T11:59:00.000-05:00Oh man, and I thought for a moment that I'd actual...Oh man, and I thought for a moment that I'd actually written a decent comment (despite the lame comparison to interactive proofs). That's the last time I sign my name to anything in this blog... :(<BR/><BR/>GusAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114259749754574222005-04-23T07:35:00.000-05:002005-04-23T07:35:00.000-05:00Scott: maybe you should've added to your post a Ho...Scott: maybe you should've added to your post a Homer-like disclaimer as in <I>"Oh, by the way, I was being <A HREF="http://www.snpp.com/episodes/8F08.html" REL="nofollow">sarcastic</A>."</I><BR/><BR/>Anyway, I really enjoyed your post, and the fact that several people misunderstood it makes it even more epigrammatic.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114215563490764822005-04-22T19:19:00.000-05:002005-04-22T19:19:00.000-05:00Gosh ... does the fact that people apparently didn...Gosh ... does the fact that people apparently didn't get my joke argue for or against the point I was trying to make?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114208586343937662005-04-22T17:23:00.000-05:002005-04-22T17:23:00.000-05:00Quoting LanceWithout a foundation of trust, scienc...Quoting Lance<BR/><I>Without a foundation of trust, science would never get anywhere.</I><BR/><BR/>Sounds quite religious, doesn't it?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114204793291892512005-04-22T16:19:00.000-05:002005-04-22T16:19:00.000-05:00To elaborate on 2: It was SCI who defined the term...<I>To elaborate on 2: It was SCI who defined the terms of submission. In the context of those terms, the students' means of exposing SCI involved zero deception. One can think of the students as verifiers who use coin tosses (literally) to catch cheating provers (SCI scammers). The protocol of interaction was established ahead of time by SCI and then SCI was caught cheating using only that protocol.</I><BR/><BR/>This would be more compelling if the conference had claimed their decision was based on a review of the paper. The conference openly admits that they have a "non-reviewed" category, where anything goes. A stupid category, but technically not fraud. The prover isn't asserting x is in L (or <BR/>not in L), so they were not "caught cheating".<BR/><BR/>I am not claiming that the conference is good, just disagreeing with the previously posted analysis.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114202559841661452005-04-22T15:42:00.000-05:002005-04-22T15:42:00.000-05:00After reading all the comments on this post, two t...After reading all the comments on this post, two things are clear to me:<BR/><BR/>1. The SCI conference is a scam.<BR/><BR/>2. The MIT students did not commit fraud because their deception was intended to be caught immediately by the refereeing process purportedly used at SCI.<BR/><BR/>To elaborate on 2: It was SCI who defined the terms of submission. In the context of those terms, the students' means of exposing SCI involved zero deception. One can think of the students as verifiers who use coin tosses (literally) to catch cheating provers (SCI scammers). The protocol of interaction was established ahead of time by SCI and then SCI was caught cheating using only that protocol.<BR/><BR/>If anything, the actions of SCI are *MUCH* closer to what I would call "fraud" than the actions of these students.<BR/><BR/>In this age of spam and deceit in the name of profit, an action that exposes shameless scammers without resorting to deceit is to be commended.<BR/><BR/>It is unfortunate that the public misinterprets this exposition as bungling, but the error of the public does not decrease the merits of the action. If we scientists pandered to the public's misconceptions in order to convince them that our work is worth their tax money then we would be little more than scammers ourselves.<BR/><BR/>Scott Aaronson spoke of a foundation of trust, but he only applied his argument towards the submitters. What about SCI? Many scientists trusted SCI to be a legitimate conference only to discover years later that publishing in that conference is an embarassment. SCI's violation of trust was far greater than that of the students (if their actions can even be called a violation of trust, which I claim they cannot).<BR/><BR/>GusAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114201395897432422005-04-22T15:23:00.000-05:002005-04-22T15:23:00.000-05:00I very strongly opppose the previous post concerni...I very strongly opppose the previous post concerning the archive compared to SCI. Putting a paper on the arxiv is not a publication. It is more like what the old technical report was. While there is moderation now, no one checks validity. Still I think that the MIT-prank paper would not have gotten into the arXiv. This is because a new author has to be "endorsed" now, which would not have happened with this paper. So, while there is actually no quality standard on the ArcIve, it is probably more restricted than SCI.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114200781921113822005-04-22T15:13:00.000-05:002005-04-22T15:13:00.000-05:00Yes, it's the same as arXiv except for 1) lack of ...Yes, it's the same as arXiv except for 1) lack of peer-moderation, 2) the $300 registration fee.<BR/><BR/>It is reasonable to think that if SCI were at all a legitimate effort, the $300 would go to moderation. It clearly does not.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114200538252590362005-04-22T15:08:00.000-05:002005-04-22T15:08:00.000-05:00Although the SCI conference may be have low standa...Although the SCI conference may be have low standards, this not really related to the bogus paper. The organizers of the conference claim that they received no review comments (presumably not even from PC members) about the bogus paper and then accepted it as a "non-reviewed paper". This seems to me like getting a bogus paper on the arXiv.org e-Print archive. It may be possible to fool an arXiv moderator, but so what.<BR/><BR/>The criticism of SCI that I think is implied by the bogus paper is mainly procedural: the PC chair could not ensure that every submission was looked at by at least one person.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114198966671422302005-04-22T14:42:00.000-05:002005-04-22T14:42:00.000-05:00There's an interesting post about this affair in D...There's an interesting post about this affair in Duh Blog:<BR/><BR/>http://duhblog.com:8668/space/start/2005-04-15/1#Vanity_Conference,_Fake_Paper,_and_Slanted_Journalism<BR/><BR/>In my words, while CS scientists think they are making fun of SCI, the general audience is making fun of CS scientists.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114198819240662222005-04-22T14:40:00.000-05:002005-04-22T14:40:00.000-05:00There are two points i would like to make here. Fi...There are two points i would like to make here. First, SCI is not a scientific endeavor. Publishing there is more akin to buying a doctorate than to doing science. So this maybe is a place for sarcasm and parody. It is also interesting how SCI's review system works. According to their website they have a database of reviewers of which they choose 3 random ones (so that there is no "human intervention"), send the paper to them, and, yes, they do not get reviews usually, i guess. It is obviousy flawed to accept the papers that did not get reviews.<BR/><BR/>The second point is that the submission and following press response might actualy hurt our field. So the news report Lance links is balanced, but if this gets more publicity people will think that computer scientists write junk papers (funded by government money!) full of gibberish, and cannot even tell their stuff apart from what monkeys type (didn't we suspect that all along? Darn commies!).<BR/><BR/>Think of the recent "evolution vs. whatever" post. It is a serious point. Everybody in computer science knows stuff like SCI is nonsense, but if the impression is made that accepting pure gibberish at a real conference is easy, too that would be very bad, indeed.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114196196228058332005-04-22T13:56:00.000-05:002005-04-22T13:56:00.000-05:00The SCI conference is really just a form of vanity...The SCI conference is really just a form of vanity press. If you examine the fees, local arrangements costs, and spam-like form of the e-mail calls for papers it becomes quite apparent that the goal of the conference is not science so much as<BR/><BR/> 1. money-making and credit for the organizers <BR/> 2. a publication for the CV of authors who can't get published in other venues<BR/> 3. an excuse for a paid vacation in a nice location<BR/><BR/>In that sense the conference itself has aspects of a scam. Some people get duped by scams (or are willing participants for other reasons) so it is certainly possible that legitimate high-quality papers may be sent there. What the MIT students did was expose one aspect of this scam. <BR/><BR/>The conference got what it deserved.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114194663416803742005-04-22T13:31:00.000-05:002005-04-22T13:31:00.000-05:00I've read on this subject, some otherwise well-res...<I> I've read on this subject, some otherwise well-respected researchers have previously published at SCI.</I><BR/><BR/>Actually a Google search as suggested returned a while back <B>no</B> well-known names. All the authors were from medium-to-small universities and even in those cases, one wonders if they knew the conference was mickey-mousish. I know of at least one colleague who submitted a paper to a similar conference unknowingly, the paper got accepted and he sent the student to present it. So he never learned how bad the conference was. Several years later some one brought to his attention that the conference was very low quality and this person no longer lists the paper in his resume and he's quite embarrased by the whole thing.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114183375895177432005-04-22T10:22:00.000-05:002005-04-22T10:22:00.000-05:00I'm having some trouble meshing Lance's opinion he...I'm having some trouble meshing Lance's opinion here with his previous P/NP and the Arts post in which is the quote "I can recognize great music but I can't create great music."<BR/><BR/>Since we can consider the possibility of a complex computation creating art, it is not at all unreasonable to consider such a computation creating scientific papers.<BR/><BR/>Doesn't this "fraud" simply amount to a demonstration that SCI is (with ~50% accuracy) only capable of recognizing paper validity through a computation equivalent to vocabulary comparison and parsing a CFG? An agrammatical paper without CS buzzwords would probably have been rejected, but that is about where their standards are. To put it another way, the MIT students didn't act as a computationally-powerful "adversary" generating the most misleading paper possible - they actually created a totally random sample of grammatically-connected buzzwords. The probability of this generating a "meaningful" paper (for common sense values of "meaningful") is, intuitively, ZERO. However, for SCI the most-likely probability is around 0.5.<BR/><BR/>It just so happens that these MIT students (and they're not alone) believe that the standard for publication should be higher - that science is not CFG-complete. Who can blame them? There is no fraud here, simply a demonstration that SCI is an opportunity to present, with 0.5 probability, anything that is at least grammatically correct for a quid pro quo payment of a few hundred dollars.<BR/><BR/>Since SCI is apparently run independently of academia and as a business, it seems fair that their performance be gauged through harsh real-world antics. As far as I can tell, this is like any "Consumer Reports" review of a service.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114182066718025612005-04-22T10:01:00.000-05:002005-04-22T10:01:00.000-05:00Anonymouns wrote:the second was only accepted as a...<B>Anonymouns wrote:</B><I>the second was only accepted as a "non-reviewed" paper.</I> <BR/><BR/>Well, one could suspect that hardly any paper is reviewed, i.e. the percentage of "non-reviewed" papers is not "very small" but close to hundred.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114177488779921422005-04-22T08:44:00.000-05:002005-04-22T08:44:00.000-05:00This is not fraud. This is an attempt to deal wi...This is not fraud. This is an attempt to deal with spammers by wasting their time. It's no more fraud than the hijinks in <A HREF="http://thespamletters.com/" REL="nofollow">The spam letters</A>. Likewise, WMSCI is not a computer science conference, it is a vanity publisher.Hughhttps://www.blogger.com/profile/08767952337717767032noreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114177161714981702005-04-22T08:39:00.000-05:002005-04-22T08:39:00.000-05:00I'm not familiar with SCI and would like those who...I'm not familiar with SCI and would like those who are criticizing it (including those behind this hoax) to elaborate: why is SCI considered a fraud? According to some other comments I've read on this subject, some otherwise well-respected researchers have previously published at SCI.<BR/><BR/>Infact, if you read the hoaxer's website on this (http://pdos.csail.mit.edu/scigen/) you'll see that they never intended fraud at all. Instead, they were hoping to expose (what they felt) were the "low standards" of the WMSCI conference. <BR/><BR/>However, I believe they failed in their original goal: one paper was rejected outright and the second was only accepted as a "non-reviewed" paper. I'm not 100% sure, but I doubt that a non-peer reviewed paper would have ultimately made it into the published proceedings.<BR/><BR/>In addition, a follow-up letter (available on their web page) from the conference indicates their reasons for accepting the paper (again, as non-reviewed)--namely, that they hadn't gotten sufficient comments from reviewers to outright reject the paper (though they curiously mention that some reviewers told them they thought the paper was a joke). The status that it was accepted under was such that the authors had complete responsibility for its content, not the conference.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114173007900358812005-04-22T07:30:00.000-05:002005-04-22T07:30:00.000-05:00"Why are these MIT students any different?"It is s..."Why are these MIT students any different?"<BR/><BR/>It is so shockingly sad that a well respected computer scientist should (choose to) fail to see the most obvious difference.<BR/><BR/>It is not about any fine line between fraud and prank, but simply about conducting versus exposing fraud.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114156187690459052005-04-22T02:49:00.000-05:002005-04-22T02:49:00.000-05:00We are not amused. Nobody even read the stupid pap...We are not amused. Nobody even read the stupid paper, it got exactly what it deserved! What would be fun is if the paper appears on the authors' resumes and is taken to be representative of their research...Cheshire Cathttps://www.blogger.com/profile/07463645065346922684noreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114155058954421352005-04-22T02:30:00.000-05:002005-04-22T02:30:00.000-05:001. Probably, your spam filter works perfectly with...1. Probably, your spam filter works perfectly with SCI's messages (for example, gmail sorts out most of them). SCI and conferences around it continiously reject to remove anyone from their mailing lists (and continue changing their email addresses, evidently, in order to fool spam filters).<BR/><BR/>2. SCI is quite different from "normal" CS conference, isn't it? For outsider, it makes bad publicity to CS conferences: I saw several news articles that referred to what's happened as "computer scientists were unable to recognize gibberish". Someone could submit some P=NP paper to SCI, and this would make even worse publicity to our community.edwardahirschhttps://www.blogger.com/profile/18094179693219521111noreply@blogger.comtag:blogger.com,1999:blog-3722233.post-1114154319751774322005-04-22T02:18:00.000-05:002005-04-22T02:18:00.000-05:00What about RL=L? I take this blog seriously. Over ...What about RL=L? I take this blog seriously. Over the past couple of decades, I have been moving closer and closer to a proof of the result, and the April 1 announcement very nearly delivered me into a state where I could have consulted the Book proof directly.Anonymousnoreply@blogger.com