@fallenhitokiri the industry is still just repeating variations of the premise that led to the classic post "Command-line Tools can be 235x faster than your Hadoop Cluster" <https://adamdrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html>
Hadoop! Remember the hype? ~10 years hasn't resulted in the vanquish of hype-driven development. The industry is eternally fashion-first (and actual, real world requirements come second).