Skip to main content

Live Coding Exercises: How NOT to hire potentially Brilliant Engineers.

I've intimated this view before but, I abhor "live coding" exercises for engineering interviews and will never have them as part of any interview process I conduct. They are simply unrealistic to real world engineering in every possible way, they only test familiarity (or luck) with a tiny subset of solution methods to a specif subset of problems...that you either "nail" or get spectacularly wrong depending on who is observing you.

They are mostly entirely unfair to the candidate on top of the pressure of having a gun under them while coding, only in the most extreme cases is coding under the gun and that's just competitions where the code is far from real world engineering related...so why test for general coding ability with such tests?? Stupid.

I posit, it is significantly more effective to see examples of a candidates finished working code in the form of a project or projects they've created. How long it took some one to get some uber algorithm working only matters should their estimates for co
mpletion bump against the business time line for getting it done...those time lines in code are almost always on the order of days or weeks NOT minutes. Also, such exercises tell you *nothing* about their ability to work around distributed problems, design algorithms or solutions that scale efficiently say across computers and that is the true talent one needs to have as a versatile problem solving coder...the minutia of solution for atomic algorithms all can be found on stack overflow in a 30 second search...real engineers are going to find and use those rather than beating their head over the syntactic niggles of trying to live code a solution that's already been done *out there*.

Ultimately there is this wide view that engineering is not a creative act which is ridiculous. As some one who is as driven by design and art as creative expression as he is by writing software or building hardware the two pillars have many strong similarities. Creativity doesn't come on a clock and forcing an engineer to do so on a clock can put many brilliant engineers in a schism that masks their ability with anxiety. Some of the greatest works ever created came in moments of utter and serene *mental peace*. This environment is the one an interviewer should be making for their candidates...one that is shaped to *their* creative process.

I interview for the laziest possible programmer, where in programming terms the lazy guy is good at building things once that scale and are efficient consistently even if they are not built in 5 minutes because that programmer is thinking *like an engineer* while building the solution. Forest- Trees thinking I like to call it.  I'd rather a coder take a bit longer to get something rock solid *at scale* than that they build something that has a very limited efficiency scope and is not scalable and none of that talent is identifiable by silly live coding exercises.

Comments

Scott said…
This is a harder problem than you give it credit for.

>How long it took some one to get some uber algorithm working only matters should their estimates for completion bump against the business time line for getting it done

This is generally untrue. If you have two devs who do the same quality work and one is twice as fast as the other, the faster one is worth twice as much to your company. They can implement four features while the other dev implements two. Faster devs either change your business timeline or they affect what features you can have within that timeline.

Other than that, when someone brings in code to show you, you have to consider: did they write it at all? Did they write it themselves? Did they get help from a smarter friend -- maybe that's the person you should be hiring?
David Saintloth said…
Your mentioned issue has been thought of and the reality is that "fast" is not a consistent thing for Engineers, you should read my engineers versus programmers post or my rube goldberg rules software development post to understand why.

Engineering complex applications is not the same as writing algorithms. You can't have some one build an efficient scalable web application on an unknown platform as an interview exercise yet that is precisely what you'd be hiring them to be on a team charged with doing.

It makes no sense to ask for the bark view when what you want to see is how the trees are distributed across the landscape. "Bark view" is important but almost never on a temporally important scale (only when shit breaks in fact!) other than that...building so that shit doesn't break ensures robust , scalable systems.

As for the issue of having code brought to you, obviously you aren't going to just look at it you are going to ask them to explain how it works to suss out authorship this is trivial. Further you will be better off asking for *live* working code...say being executed from a web application url they provide to you...that is the BEST by far example of engineering demonstrated as you get proof a) the code works b) they know where and how it is integrated into their system proving it is their system and c) they can walk you through the code itself and show you how it does that. Check and Mate, time to hire that person!!
David Saintloth said…
Engineers versus Programmers:

http://sent2null.blogspot.com/2012/03/engineers-versus-programmers.html

Rube Goldberg Rules:

http://sent2null.blogspot.com/2013/01/rube-goldberg-rules-software-development.html

Popular posts from this blog

the attributes of web 3.0...

As the US economy continues to suffer the doldrums of stagnant investment in many industries, belt tightening budgets in many of the largest cities and continuous rounds of lay offs at some of the oldest of corporations, it is little comfort to those suffering through economic problems that what is happening now, has happened before. True, the severity of the downturn might have been different but the common factors of people and businesses being forced to do more with less is the theme of the times. Like environmental shocks to an ecosystem, stresses to the economic system lead to people hunkering down to last the storm, but it is instructive to realize that during the storm, all that idle time in the shelter affords people the ability to solve previous or existing problems. Likewise, economic downturns enable enterprising individuals and corporations the ability to make bold decisions with regard to marketing , sales or product focus that can lead to incredible gains as the economic

How many cofactors for inducing expression of every cell type?

Another revolution in iPSC technology announced: "Also known as iPS cells, these cells can become virtually any cell type in the human body -- just like embryonic stem cells. Then last year, Gladstone Senior Investigator Sheng Ding, PhD, announced that he had used a combination of small molecules and genetic factors to transform skin cells directly into neural stem cells. Today, Dr. Huang takes a new tack by using one genetic factor -- Sox2 -- to directly reprogram one cell type into another without reverting to the pluripotent state." -- So the method invented by Yamanaka is now refined to rely only 1 cofactor and b) directly generate the target cell type from the source cell type (skin to neuron) without the stem like intermediate stage.  It also mentions that oncogenic triggering was eliminated in their testing. Now comparative methods can be used to discover other types...the question is..is Sox2 critical for all types? It may be that skin to neuron relies on Sox2

AgilEntity Architecture: Action Oriented Workflow

Permissions, fine grained versus management headache The usual method for determining which users can perform a given function on a given object in a managed system, employs providing those Users with specific access rights via the use of permissions. Often these permissions are also able to be granted to collections called Groups, to which Users are added. The combination of Permissions and Groups provides the ability to provide as atomic a dissemination of rights across the User space as possible. However, this granularity comes at the price of reduced efficiency for managing the created permissions and more importantly the Groups that collect Users designated to perform sets of actions. Essentially the Groups serve as access control lists in many systems, which for the variable and often changing environment of business applications means a need to constantly update the ACL’s (groups) in order to add or remove individuals based on their ability to perform cert