Full-Stack Engineer For DevOps: Fact Or Fiction

Full stack developer is a common DevOps / Agile term, but Full Stack Engineer seems to be less so.

This article from 2014 explains what they are and how to get hold of them.  It’s now 2017 and how many Full Stack Engineers do you know?

via Full-Stack Engineer For DevOps: Fact Or Fiction – InformationWeek

Posted in DevOps, Things I am reading | Leave a comment

DéjàVu: a map of code duplicates on GitHub – Adrian Colyer’s take

This paper analyzes a corpus of 4.5 million non-fork projects hosted on GitHub representing over 482 million files written in Java, C++, Python, and JavaScript. We found that this corpus has a mere 85 million unique files.

But as Adrian points out not really, it’s just framework duplicates in people’s repos.

I can see this leading into another paper, once they figure out how to ignore the frameworks.

Really great stuff…

via DéjàVu: a map of code duplicates on GitHub | the morning paper

Posted in Things I am reading | Leave a comment

Security and DevOps – Gartner

Paywall as always with Gartner, but they do give away this nice free pic…

Via: https://www.gartner.com/document/3823259

Posted in DevOps | Leave a comment

Web Testing with Selenium, Chrome, Python, and Xvfb

Well okay not quite web testing, but almost.  In September I had a need to login to a website and scrape some data from it.  It uses the same functionality as web testing, selenium.

The website in question, that I will not mention, was secured by a SAML based Single-Sign-on authentication service.  This initially caused some issues, but was overcome by using Xvfb. The SAML provider was smart enough to notice that I was trying to run Google Chrome in headless mode (because I wasn’t running this on my laptop, but a server based in the cloud).  Of course running web testing software against sites does look like script kiddies hacking i suppose.  I used, like all others, Xvfb which allows Google Chrome to run headfull(?) like a normal browser would on your laptop.

Another discovery is that selenium, is really slow to parse things such as tables.  In the end lxml was utilised and does this around 20 times faster than selenium.

So how to install all those goodies…  On a fairly bare bones Ubuntu 16.04 server, the following needs to be done. Note that you can’t get everything via apt and pip, so you need to download some artifacts directly.
see install.sh

My demo script is quite long but I have purposely left enough in there to enable others to see the additional functions I wrote to ease things a little.  Plus of course there is a nice decorator function that allows you to time each function as they are called.  This also stores in a dict/hash to that you can see the min/mean/max timing for each.
see simple-demo.py

Running the script with Xvfb, is in actual fact very easy.
see run-via-xvfb.sh

With the timing of functions enabled you can see how long each action takes…
see file-results

So hopefully there is enough information to get someone started quickly using Web Testing with Selenium, Chrome, Python, and Xvfb.  It took quite a while to collate all of that and get it working as there are many websites with outdated examples, depreciated functionality and of course most examples are Java based.

Have fun!

Posted in Automation | Leave a comment

API Evangelist – Security

The way my research works is that I keep an eye on the world of APIs through monitoring the social media, blogs, Github, and other channels of companies, organizations, institutions, and agencies doing interesting things with APIs. I curate information as I discover and learn across the API sector, then I craft stories for my blog(s). Eventually, all of this ends up being published to the main API Evangelist blog, as well as the 70+ individual areas of my research from definition to deprecation.

Ed:  Some really really great info here…

via API Evangelist – Security

Posted in Automation, Things I am reading | Leave a comment

User experience design for APIs

User experience (UX) should be central in application programming interface (API) design. A well-designed API, making complicated tasks feel easy, will probably prevent a lot more pain in this world than a brilliant new design for a bedside lamp ever would. So why does API UX design so often feel like an afterthought, compared to even furniture design? Why is there a profound lack of design culture among developers?

Ed: Great stuff here…

via User experience design for APIs

Posted in DevOps, Things I am reading | Leave a comment

The true cost of big staff meetings (and how to break your team’s addiction to them)

Oh meetings, don’t you just love them…

Some helpful tips on how to get more out of meetings.

via The true cost of staff meetings (and how to avoid them) – RescueTime Blog

Posted in Uncategorized | Leave a comment

When Artificial Intelligence Meets git

This is where i see ChatOps going… LOL


via When Artificial Intelligence Meets git

Posted in Uncategorized | Leave a comment

Black Friday is dying – according to consumer behaviour researchers


Awesome – can’t wait, no more of the above.  Though i did bag a few bargains on Amazon today.

via Black Friday is dying and GP Shopper

Posted in Uncategorized | Leave a comment

Functional Testing Versus Nonfunctional Testing


  • Functional requirements: describe the behavior/execution of the software system.

  • Nonfunctional requirements: describe performance or usability of the software system.

via What’s the Difference Between Functional and Nonfunctional Testing? – DZone DevOps

Posted in Uncategorized | Leave a comment