Tuesday, April 04, 2006

How Many Students?

From an assistant professor comes a question
How many Ph.D. students should a professor advise?
There is no single answer. The usual constraints are time and money. It depends on one's teaching, administrative and other time constrains (such as advising Master's and Bachelor students) as well as the ability to fund such students. Also how do you count part-time students, students not in residence, students you officially or unofficially co-advise and students from other schools who are long-time visitors at your institution.

I ideally like to advise three full-time Ph.D. students at any one time. More and I find it difficult to find interesting research problems for the students and not enough time to properly help their research along.

Some professors can handle more students, some should never advise any students. Particularly in the more applied areas of computer science, professors need a considerable number of slaves graduate students to help them with their projects. It's much easier to tell someone what to code than what to prove.

40 comments:

  1. "It's much easier to tell someone what to code than what to prove."

    I totally agree with that. But, you know, most systems advisors do not acknowledge that..

    ReplyDelete
  2. i disagree. more snobbishness from theory folks. good job.

    it is just as hard to write good code as it is to write good proofs.

    most theory profs should never tell students what to code, since they have never or have rarely done it themselves.

    the longer you insist theory is special the longer you'll whine about lack of funding.

    ReplyDelete
  3. maybe the difference is that when a theory advisor gives out a problem to a student, the advisor tries not to work on this problem himself or he would probably solve it and leave the student without a phd. when a systems advisor gives a design/coding problem to a student, the advisor is all too happy not to have to do it himself.

    so theory advisors need to carefully pick problems that they dont want to work on themselves to give to their students. systems advisors can just give any of their coding work to their students. Hence, it's harder for theory advisors to have enough problems to give out and therefore harder to maintain a lot of grad students.

    I dont think lance was claiming that writing good code is easier. he was claiming that there is more of it to give out.

    ReplyDelete
  4. To the anonymous second commenter...

    As a theorist who plays a bit on the systems side of the fence, I'd like to comment on your comment.

    I think you have a valid point, although I think you could have expressed it more politely. I would indeed say it is difficult to write very good code. Perhaps more importantly (and perhaps this was your point) it is very difficult to come up with very good high-level ideas -- what I would call system designs -- that can have a big impact when coded appropriately.

    Now, let me try to make Lance's point, as I see it, a bit more clearly (and perhaps politely also). I would say it is much easier to do mediocre (or poor) systems work than to do mediocre or poor theory work. Mediocre systems work means you end up writing code implementing something -- probably something your advisor told you to write so you could finish. The something might not be great, but at the end of the day, you still have a working product to show people, and perhaps some people will use or like it. Just the fact that you have something means something.

    Mediocre theory work is much harder. Your advisor can't tell you how to prove something, or there's no point -- he/she could have written it up faster themselves. (While it is true systems advisors could write the code faster and better themselves, they generally don't have time -- this is generally not a problem for writing down a proof!) And if at the end of the day you have just not so interesting results, your audience is essentially empty.

    So I agree with you that the top work in systems is as hard as the top work in theory. But I hope you'll consider that mediocre work -- unfortunately, the majority of work produced in general, but arguably especially by graduate students -- might be easier in systems.

    Of course, I could be wrong.

    ReplyDelete
  5. "i disagree. more snobbishness from theory folks. good job."

    Even though it should be hard for you to accept, this is the case.

    It is not snobbishness to claim that theoretical computer science is the toughest field of computer science; it is just the truth.

    The problem is that systems people see this fact as an elitistic attitude of theorists.

    "most theory profs should never tell students what to code, since they have never or have rarely done it themselves."


    Nobody claims that programming is easy; however, it does not require the intellectual capacity necessesary to produce a deep theorem in mathematics or theoretical computer science.

    Note that several researchers with a PhD in theoretical computer science now do research in applied fields like databases, AI or networks (and are very established in these fields). Can you provide an example in the opposite direction?

    ReplyDelete
  6. Note that several researchers with a PhD in theoretical computer science now do research in applied fields like databases, AI or networks (and are very established in these fields). Can you provide an example in the opposite direction?

    Is it because theory is difficult or is it because it is uninteresting/"useless" to a large part of community?

    ReplyDelete
  7. Everything is useful.

    The thing is that theorists can also do research in practical fields (and they do) if they decide to. For a systems person, the opposite direction would be (almost) impossible.

    ReplyDelete
  8. Most systems research isn't science (and I say this as a software researcher). Someone mentioned it was hard to come up with good systems designs. Well, we don't really know, because 90% of the research consists of unverified/unverifiable design claims that are either empirically vacuous or tested on toy examples. Theory has a strong mathematical pedigree that provides a good sense for what is valuable (and presumably difficult to do). Systems, software engineering in particular, lacks a sense of what is good work. We need to fix this.

    ReplyDelete
  9. The thing is that theorists can also do research in practical fields (and they do) if they decide to. For a systems person, the opposite direction would be (almost) impossible.

    I don't think you really know what you are talking about.

    "Applied researchers" do "theory research" all the time. Just browse proceedings of some of the premier applied conferences (SIGMOD, SIGCOMM, ICCV, etc). You will see plenty of insightful algorithmic research happening there, proofs included.

    ReplyDelete
  10. Geez, looks like some raw nerves were touched here... if I could make explicit a point that I don't think anyone has come out and said yet (though it's somewhat implicit in some earlier comments)... a lot of good sized systems research projects can easily accomodate half a dozen grad student programmers, some of them even more. If a professor has a couple projects going (which is a lot, but is certainly doable), this could correspond to a pretty large number of graduate students, all of whom have clearly defined goals and are not feeling left behind or neglected by their adviser.

    In contrast, "large-scale" theory projects are much more rare, since the development of theory is by nature less structured -- you can't plan in advance exactly who will prove what. Thus, theory students can require more hands-on guidance, since often each student will be involved in his or her own unique line of research, with no straightforward global roadmap.

    This says nothing about the relative hardness of systems or theory, and I think people on both sides are being needlessly derogatory. All it says, and I think all Lance meant to imply, is that it is often easier to find work for systems grad students to do (however hard the work itself may be), since the manpower needed for a reasonably large systems project is relatively high, and the division of labor is much simpler than in most theory work.

    ReplyDelete
  11. " "Applied researchers" do "theory research" all the time. Just browse proceedings of some of the premier applied conferences (SIGMOD, SIGCOMM, ICCV, etc). You will see plenty of insightful algorithmic research happening there, proofs included."

    Obviously, you are not a theoretical computer scientist.

    Indeed, several papers in these conferences have an algorithmic flavor (notice that most of them have a theoretical computer scientist as co-author). However, none of them constitutes an advancement in the foundations of computer science.

    Proving that a problem is NP-complete using an almost trivial reduction is not what theory is about. Same for devising a trivial algorithm based on standard techniques.


    I am not saying that these stuff is not respectable research, but such a paper is not considered a TCS paper.

    ReplyDelete
  12. What I don't get is why so many people are responding to an obvious troll...

    ReplyDelete
  13. Particularly in the more applied areas of computer science, professors need a considerable number of (slaves) graduate students to help them with their projects. It's much easier to tell someone what to code than what to prove.

    Although I don't agree with the pejorative nature of the way this is stated, it has a lot of truth in it for a simple reason: Systems designs have much more decomposable structure than proofs. This decomposability is a key feature that theory research generally lacks. How many of us could take our favorite problem and, based on a single high-level design, be able to parcel out pieces that we have a good idea will work together?

    It isn't that theory is inherently harder than systems (or vice versa). It is just that it is harder to have a single unifying theory project that will yield good meaty problems for large numbers of students.

    ReplyDelete
  14. Certainly theoretical research and systems research require different (but not mutually exclusive) kinds of talent.

    The issue is not which is harder. Rather, Lance was making a comment about the conditions for doing valuable research. One can't keep an outstanding theorist down - nothing stops him/her from solving a major open problem and getting due recognition. On the other hand, even a very talented systems researcher needs a lot of other things to go right to make it in academia. Systems research is intrinsically more political, like experimental physics or biology.

    Does anyone seriously deny this? To the anonymous commenter who commented on an earlier post about STOC/FOCS being "beauty contests": you don't know how lucky you are to be a theorist.

    ReplyDelete
  15. I agree that "hard" is a stupid adjective to use. For me, systems research would be much "harder" than theory research because I adore theory, and even when it's a struggle, I find it unfailingly fun.

    On the other hand, one can think of meaningful ways to differentiate "theory" from "systems" that might fall along the lines of "intellectual difficulty."

    How many theory projects does a typical theorist start, but then give up on--at least for a while--without meaningful results or a publication? (Hint: If your answer is not at least 40%, you should probably be working on harder problems.) I suspect that the same is not true of systems projects, and this alone can create difficulty with students. In general, we only have vague ideas about what the solution to a problem should look like, and we are often wrong.

    ReplyDelete
  16. About the 40% above, well some would say that it is more like 90%. Lance - what do you think is the right percantage?

    ReplyDelete
  17. I figured I should try not to piss off both theorists and systemists simultaneously, so I threw in a low-ball figure. I think 90% is probably too high. It might mean that you're giving up too easily :)

    ReplyDelete
  18. I think that it would be interesting to ear the students about this question. How many students to you think that you adviser should have, and why?

    Luis Antunes

    ReplyDelete
  19. As someone pointed out earlier in this debate, I think there will always be a arguments as to whether theory or systems research is harder (or more valuable), as has been with theoretical and experimental branches of the hard sciences. No point arguing about this.

    But at the end of the day, both are valuable pieces of research. Experimental research, by its nature, is more engineering-oriented (read coding), and theory is more science-oriented.

    Another comment I had was on how theoretical computer scientists often like to think of themselves as doing "mathematics". In my opinion, apart from a few, top, theoretical computer scientists, no-one is doing the real hard "mathematics". Mention to a real mathematician that you are doing "mathematics", and I'm sure that he will laugh out loud.

    As to an earlier comment about it being easier to do "mediocre" systems work than doing "mediocre" theory work, I think you hit the nail on the head. The same also holds if you replace the word "mediocre" with "incremental". It is much easier to have incremental results in systemsy areas than in the theoretical areas of CS.

    Anyway, my 2c to this pointless debate...

    ReplyDelete
  20. ''However, none of them constitutes an advancement in the foundations of computer science.''

    -Like a whole bunch of STOC/FOCS papers.

    ReplyDelete
  21. Systems is more useful.

    Theory is more beautiful.

    The End.

    ReplyDelete
  22. Interesting how this whole discussion got sidetracked based on one throw away comment...

    Take note Lance!

    Back to the question. How many PhD students should a THEORY advisor have?

    I think 3 is a good number, but more or less depending on time, how many good research ideas the advisor currently has, his/her energy level and so on.

    ReplyDelete
  23. ... several researchers with a PhD in theoretical computer science now do research in applied fields like databases, AI or networks

    So, any opinion on why these researchers moved away from the more intellectually challenging and beautiful TCS?

    ReplyDelete
  24. I think 2 is a good number.

    I have a friend who is a biologist. When she has an interesting idea, before pursuing it she has to think carefully about the resources needed. 6 months worth of work in the wet lab had better lead somewhere! There is often no middle ground between 0 and 6 months.

    In Theory, we have the luxury of being able to allocate our time fractionally: "I'll commit to working on this problem for x [hours, days, weeks, months]", then decide whether to commit some more time or not. We get to choose x. Biologists don't. It's a strong incentive for them to restrict their research to projects with high expected yield, for which they are have good idea in advance that the outcome will be publishable: what theorists would call "easy" problems. The situation for big systems projects might be similar to biology...

    So, it's much easier for us theorists to spend some fraction of our effort on "hard" problems, that is, problems on which we are almost clueless. On the other hand, at the end of the day, even in Theory, very few papers are truly surprising ...

    ReplyDelete
  25. In my opinion, apart from a few, top, theoretical computer scientists, no-one is doing the real hard "mathematics".

    Not in a conventional sense, for sure.

    Mention to a real mathematician that you are doing "mathematics", and I'm sure that he will laugh out loud.

    That is not a measure of anything. Mathematicians as a group are a particularly snobbish bunch, particularly after the G.H. Hardy era. They used to say the exact same thing at one time or another about probability, statistics, logic, graph theory, combinatorics. In the end of all of those "laughing out loud" mathematicians were proven wrong.

    It is quite interesting that many of the absolute top mathematicians of this century (von Neumann, Godel, Kolmogorov, Arnold, Smale, Thurston, Odlyzko, Graham, Turing) welcomed computers and saw value in them. It is the the next tier of lesser stars that tends to be less CS-friendly.

    ReplyDelete
  26. i agree there is a troll here. the troll is lance. he admits this in his podcasts, that he likes to just state things to cause comments.

    ReplyDelete
  27. "that he likes to state things just to cause comments"

    yes, my friend, that's a working definition of a "blogger" :)

    ReplyDelete
  28. I kinda agree with Claire Kenyen. And speaking of biology research, I heard that some biologist once said, "the idea is cheap." I guess that it is more or less true in most of biology or systems research.

    ReplyDelete
  29. "the idea is cheap." I guess that it is more or less true in most of biology or systems research.

    That is also more or less true in most of theory research. Except for a few top papers each year, the rest is crap. Which is also the same with biology and systems research.

    ReplyDelete
  30. It is the the next tier of lesser stars that tends to be less CS-friendly.

    Precisely. It is just the lesser theoretical computer scientists who tend to be less systems-friendly.

    ReplyDelete
  31. If you guys want to pick on somebody for having lots of easy work for grad students, not that it is a measure of whether something is easy or not. You should pick experimental Particle Physics. I think there you can find like 20 students to a researcher or something. Somebody has to build the experiments. (okay I'm exagerating but it is a lot)

    But here's the flip side of the question, how many professors should a grad student get to know his/her work?

    ReplyDelete
  32. 20 is not an exaggeration. look at how many authors this experimental physics paper has!
    http://lss.fnal.gov/archive/1997/pub/Pub-97-290-E.pdf

    ReplyDelete
  33. 20 is not an exaggeration. look at how many authors this experimental physics paper has!

    But everyone knows that Hafen and Yoshida did most of the work.

    ReplyDelete
  34. You must be joking -- everyone knows it's Proudfoot and Worm.

    ReplyDelete
  35. These flame wars have been great fun.

    Next topic: Which theoretical computer scientist has the most "distinctive" fashion sense?

    ReplyDelete
  36. Haha ... this is very anonymous ... anonymous Raghav ...

    ReplyDelete
  37. write on, buddy

    ReplyDelete
  38. Next topic: Which theoretical computer scientist has the most "distinctive" fashion sense?

    I vote for Goldreich.

    ReplyDelete
  39. Next topic: Which theoretical computer scientist has the most "distinctive" fashion sense?

    I vote for Goldreich.


    Nah, it's gotta be Anna Karlin, or Jason Hartline.

    ReplyDelete
  40. Lead image:(two choices)
    (http://www.cultureby.com/photos/uncategorized/2008/03/05/img_0307.jpg)
    or
    (http://neveryetmelted.com/wp-images/Antikythera20.jpg)

    So much of what I have seen since I have began studying computational complexity simply amazes me. I have come from an outsiders perspective peering into this vast new world where obvious things hide themselves and complex things take center stage to be studied like pellets of sand beneath a microscope. I will say this one thing: I have never been treated with more disdain in an academic setting. I have had M.I.T. (insert logo: http://web.mit.edu/graphicidentity/img/logo/mitlogo.gif) Assistant Professor Scott Aaronson threaten to contact my Internet Service Provider and call me a "goon" for disproving this theorem publicly. I have been called a "troll" and "couch boy" the latter I have no idea. I have had my I.P. address blocked from Wikipedia and have been sent threatening emails from Wikipedia administrators saying, "Wikipedia doesn't need you." Since I began pursuing my proof of computational complexity my Wikipedia profile for my work as a screenwriter (which had remained untouched for the better part of three years) was immediately flagged as "non-notable" and deleted. And all because the mathematics and code I was inputting was too advanced for wiki language to swallow without causing system problems and offending apparently some very sensitive people.
    - Hide quoted text -


    Basically, as the case may certainly be there seem to be a lot of people out there absolutely insistent that "P" does not equal "NP". But I have to wonder, if it is only theory we are debating here, what is so vested by this people that they defend an insistent of an impossibility as if it were the holy grail? It just does not make sense to me. I will say this, especially, it does not make sense to argue that something such as P equals NP has to be impossible. If it were true there are well documented articles such as this one in the Boston Globe (www.boston.com/news/science/articles/2009/02/09/great_unknowns/) which blatantly list all the potential benefits we might experience if the scientific community would accept P=NP. The list includes advances in "Protein Folding" which could spur unprecedented growth and advances and biological research which may well include cures for diseases like cancer and H.I.V. So dare I say, why are noted professors at top universities such as Scott Aaronson at M.I.T. and Stephen Arthur Cook at the University of Toronto so insistent of its impossibility? What could be so motivating as one would defend such a contrary position to which being contrariety holds no obvious benefit for society at large. The elephant in the room seems to be that this argument has been raging and churning for years ever since Stephen Cook invented the class "NP-Complete" back in 1970.

    My goal, my dream, in pursuing a proof that P=NP was not to win a million dollars and notoriety, but to help the people in the world use the technology to better take care of themselves and their families. My goals personally are to help my young niece who just had an implant put in her ear so she could hear better and to spur advances in cancer research as my uncle and Godfather was in the last month diagnosed with kidney and bone cancer. So still, I continue on, every morning pursuing the solution despite the animosity and ignorance.

    My dreams are simply bigger than theirs. My dreams are not to predict the S&P 500 and compromise the security of banks by collapsing known elements of cryptography. My dreams are that a young researcher in Tibet working by himself may uncover a cure for cancer that no one had seen. My goal is that a hobby mechanic in rural Russia with access to the Internet will invent a hybrid computer driven engine which will best all the struggling automakers who we continue to float financially like giant sick whales out to sea. My dream is that the academic community would allow open access to citizens at large and not simply the ones who can afford the prestigious school tuition. The basis of my plea: history has shown it to be the best path.

    With only three months of formal education he became one of the greatest inventors and industrial leaders in history. Edison obtained 1,093 United States patents, the most issued to any individual.

    (image: Thomas Edison's original patent for an "electric lamp". http://www.historicaldocuments.com/ThomasEdisonLightBulbPatent2.jpg)
    or
    (image: Thomas Edison. http://www.archives.gov/exhibits/american_originals_iv/images/thomas_edison/thomas_edison.jpg)

    A Quote:

    "If smart people all had Ph.D.'s we would not have light bulbs." --Martin Musatov on Thomas Edison

    Call this my prayer or call it my plea it is my cry to the scientific community and to God in heaven can we please work together here and accomplish some good in the world instead of warbled disagreement? My last thought is to ask yourself why would anyone insist on the absolute impossibility of something that could bring so much good to the world?

    Quotes by Thomas Edison:(several of them but please include as many as possible as they all fit)

    "Hell, there are no rules here we're trying to accomplish something."- THOMAS EDISON

    "I didn't fail ten thousand times. I successfully eliminated, ten thousand times, materials and combinations which wouldn't work."

    "I never perfected an invention that I did not think about in terms of the service it might give others."

    "I am more of a sponge than an inventor. I absorb ideas from every source. My principal business is giving commercial value to the brilliant but misdirected ideas of others."

    "Time is really the only capital that any human being has, and the one thing that he can't afford to lose."

    "I find out what the world needs. Then I go ahead and try to invent it."

    "I have more respect for the fellow with a single idea who gets there than for the fellow with a thousand ideas who does nothing."

    "Many of life's failures are people who did not realize how close they were to success when they gave up."

    Thanks for reading this post. If you have any comments or suggestions please feel free to contact me through this website.

    You have to wonder with stories like these, could there be something more to this whole element that as to yet remains unseen.

    VAST SPY SYSTEM LOOTS COMPUTERS IN 103 COUNTRIES... (N.Y. Times, Front Page - tomorrow)
    Canadians find network... (AP News)


    My name is Martin Michael Musatov and these are all the things I have been able to do since I started my proof:

    1) I have been able to successfully publish documents and images on web servers run by the European Organization for Nuclear Research or Cern.

    -http://www.cern.ch
    -http://cdsweb.cern.ch/record/1164206/files/s1-ln5758210-9223534-1939656818Hwf-1468147288IdV-15212827115758210PDF_HI0001.pdf (Paper/experiment I conducted)
    -http://documents.cern.ch/photo/photo-tsic/icon-dfbx-2009-001.gif (image I uploaded as a documented Astro-particle physics experiment)
    -http://pisnpplus1.blogspot.com (blog I set up outlining my experience at CERN)

    2) I have been able to gather and reproduce several documents and demonstrations which prove the results found on this site: http://light-symmetry.blogspot.com and several other sites at http://www.newmedici.com and http://www.youtube.com/watch?v=_5CRshmqvuA&feature=channel_page

    ReplyDelete