Skip to main content

Live Coding Exercises: How NOT to hire potentially Brilliant Engineers.

I've intimated this view before but, I abhor "live coding" exercises for engineering interviews and will never have them as part of any interview process I conduct. They are simply unrealistic to real world engineering in every possible way, they only test familiarity (or luck) with a tiny subset of solution methods to a specif subset of problems...that you either "nail" or get spectacularly wrong depending on who is observing you.

They are mostly entirely unfair to the candidate on top of the pressure of having a gun under them while coding, only in the most extreme cases is coding under the gun and that's just competitions where the code is far from real world engineering related...so why test for general coding ability with such tests?? Stupid.

I posit, it is significantly more effective to see examples of a candidates finished working code in the form of a project or projects they've created. How long it took some one to get some uber algorithm working only matters should their estimates for co
mpletion bump against the business time line for getting it done...those time lines in code are almost always on the order of days or weeks NOT minutes. Also, such exercises tell you *nothing* about their ability to work around distributed problems, design algorithms or solutions that scale efficiently say across computers and that is the true talent one needs to have as a versatile problem solving coder...the minutia of solution for atomic algorithms all can be found on stack overflow in a 30 second search...real engineers are going to find and use those rather than beating their head over the syntactic niggles of trying to live code a solution that's already been done *out there*.

Ultimately there is this wide view that engineering is not a creative act which is ridiculous. As some one who is as driven by design and art as creative expression as he is by writing software or building hardware the two pillars have many strong similarities. Creativity doesn't come on a clock and forcing an engineer to do so on a clock can put many brilliant engineers in a schism that masks their ability with anxiety. Some of the greatest works ever created came in moments of utter and serene *mental peace*. This environment is the one an interviewer should be making for their candidates...one that is shaped to *their* creative process.

I interview for the laziest possible programmer, where in programming terms the lazy guy is good at building things once that scale and are efficient consistently even if they are not built in 5 minutes because that programmer is thinking *like an engineer* while building the solution. Forest- Trees thinking I like to call it.  I'd rather a coder take a bit longer to get something rock solid *at scale* than that they build something that has a very limited efficiency scope and is not scalable and none of that talent is identifiable by silly live coding exercises.

Comments

Scott said…
This is a harder problem than you give it credit for.

>How long it took some one to get some uber algorithm working only matters should their estimates for completion bump against the business time line for getting it done

This is generally untrue. If you have two devs who do the same quality work and one is twice as fast as the other, the faster one is worth twice as much to your company. They can implement four features while the other dev implements two. Faster devs either change your business timeline or they affect what features you can have within that timeline.

Other than that, when someone brings in code to show you, you have to consider: did they write it at all? Did they write it themselves? Did they get help from a smarter friend -- maybe that's the person you should be hiring?
David Saintloth said…
Your mentioned issue has been thought of and the reality is that "fast" is not a consistent thing for Engineers, you should read my engineers versus programmers post or my rube goldberg rules software development post to understand why.

Engineering complex applications is not the same as writing algorithms. You can't have some one build an efficient scalable web application on an unknown platform as an interview exercise yet that is precisely what you'd be hiring them to be on a team charged with doing.

It makes no sense to ask for the bark view when what you want to see is how the trees are distributed across the landscape. "Bark view" is important but almost never on a temporally important scale (only when shit breaks in fact!) other than that...building so that shit doesn't break ensures robust , scalable systems.

As for the issue of having code brought to you, obviously you aren't going to just look at it you are going to ask them to explain how it works to suss out authorship this is trivial. Further you will be better off asking for *live* working code...say being executed from a web application url they provide to you...that is the BEST by far example of engineering demonstrated as you get proof a) the code works b) they know where and how it is integrated into their system proving it is their system and c) they can walk you through the code itself and show you how it does that. Check and Mate, time to hire that person!!
David Saintloth said…
Engineers versus Programmers:

http://sent2null.blogspot.com/2012/03/engineers-versus-programmers.html

Rube Goldberg Rules:

http://sent2null.blogspot.com/2013/01/rube-goldberg-rules-software-development.html

Popular posts from this blog

Deconstructing Landmark Forum

Deconstructing Landmark Forum:




Prologue:

Recently I was introduced to the Landmark Education organization by a girlfriend, she was effusive about the many lessons she learned and the "breakthroughs" she had while taking their "forum" and other self help and improvement seminar programs. I was immediately credulous, as a student of science I often find myself playing the advocate of reason when discussion emerges over any particular topic. Often the subjects that provide the most fuel for application of this reason based approach to information analysis are seemingly difficult to quantify without descending into machine gun fire ejaculation of "ideas" with little but anecdotal support behind them. The books of experience that people in various areas serve as the guide for their views a priori of new evidence, this bias against the future by correlation with the past often serves to hold people back from changing their views to suit
new observations...the…

How the internet killed Jonny Depp (for a few hours)

About 10 minutes ago I came across an article on Huffingtonpost.com that simply mentioned that famous actor Johnny Depp is not dead. Apparently a rumor of the unfortunate demise of the "Pirates of the Caribbean" and "Edward Scissorhands" star in a road accident in Paris was a hoax. This incident though highlights something I've wanted to blog about for some time, namely the hoax was enabled by the real time communication media that we have today on the internet. All it takes are for sufficiently trusted agents online in social networks such as Facebook or Twitter to get the faulty information, for that information to spread rapidly as a "meme" through the internet and soon off the internet into the real world.

This ability for information to spread so rapidly is only recent and was born on the backs of real time social media services like Facebook and Twitter. We saw most recently the power of information spread using these tools in the U.S. election …

AgilEntity Architecture: Action Oriented Workflow

Permissions, fine grained versus management headache
The usual method for determining which users can perform a given function on a given object in a managed system, employs providing those Users with specific access rights via the use of permissions. Often these permissions are also able to be granted to collections called Groups, to which Users are added. The combination of Permissions and Groups provides the ability to provide as atomic a dissemination of rights across the User space as possible. However, this granularity comes at the price of reduced efficiency for managing the created permissions and more importantly the Groups that collect Users designated to perform sets of actions. Essentially the Groups serve as access control lists in many systems, which for the variable and often changing environment of business applications means a need to constantly update the ACL’s (groups) in order to add or remove individuals based on their ability to perform certain actions. Also, the…