How do I evaluate an IDE?

Question

I don't want to know which IDE is best, because that's subjective. I'd like to know how to evaluate an IDE. I'm primarily a vim user, and realistically happy there, but occasionally look at languages that have powerful IDE's and I consider using them.

The problem I run into is that they mostly seem the same to me. Certainly any of them will work, but when trying to decide which IDE to invest time in how do I decide?

What features should I be testing to see if I like the way A or B works better? Obviously some IDE's are specifically tailored to a language, but given a choice between say Netbeans, Eclipse, and Intellij IDEA, how would I decide? as a novice they seem the same.

_{When evaluating I generally try the editor, a few configuration options, file browser. I think my colleagues all basically the same as me and don't use IDE. I also doubt I'd end up using the IDE for work, because Perl shop, and I'm happy with vim for that, I'm simply trying to figure out how to use them in the context of languages that aren't day job and have solid IDE support.}

Answer 1

Try them out!

You mentioned that you're a vim user. Assuming that you don't want to give up your superpowers, you'll probably want to see which IDEs have better vim modes.

Think about if you want an IDE that works with many languages, or multiple which are fantastic at the language they specialize in.

It's all a matter of opinion.

Answer 2

An IDE is supposed to increase your productivity. That should be your criteria.

Whatever IDE's you wanted to try, download and install them first. Try coding in each of them, one by one. Or try one a day. By the end, I'm sure you will figure out by yourself which one could make you more productive.

Each IDE has its own settings, keyboard shortcuts, behaviors, etc and if you keep using them regularly, you will get comfortable around them and get used to them. Here are some other factors you might want to consider when evaluating IDE's:

1. If it is in active development
2. If it has good community support(and wide adoption as well)
3. If it has a good and growing number of plugins/extensions
4. Might not be relevant - but if it is free or paid

I have been using eclipse for 3 years until my colleague asked me to try IntelliJ IDEA. I have been very comfortable with eclipse for 3 years. However, I liked IntelliJ better as it is as they have advertised - more intelligent. Plus, they have a community edition that is open sourced and free. So, I switched to IntelliJ as it improved my productivity, but whenever I am helping other colleagues who are using Eclipse, I won't have trouble with that.

I personally find myself trying every IDE I get across, because, the IDE's have a lot of scope for improvement and they will keep getting better and intelligent.

Answer 3

There's not much point in defining evaluation criteria. Even if you define some, you will have to play with the IDE to decide if it satisfies them, but then again by playing with the IDE you will encounter things you like or dislike about it anyway, regardless of whether you established criteria or not.

My algorithm is: I choose the defacto standard for the language/SDK I'm using and just wait and see. If I encounter too much problems I'll consider switching to an IDE which is promised (by advertisement or word of mouth) to not have these specific issues.

As others have mentioned, since you're a vim user, one easy thing you can do is look at available vim emulation plugins.

Answer 4

As a developer, I consider whichever one helps me get the job done the quickest with the least frustration. Also, one that is popular because I know I can find support for just about anything via google if that is the case. As a fellow vim'er I tend to choose ones with vim plugins (e.g. eclipse and visual studio both have vim plugins). Then it's the best of both worlds :)