Developers Struggle to Keep up With Increasing Demand for Data Streaming

Technology > IT

Developers are trying to keep up with the spiking industry needs for real-time data services, as companies begin turning to streaming as a platform to deliver data / Photo by: ndul via 123RF

 

Developers are trying to keep up with the spiking industry needs for real-time data services, as companies begin turning to streaming as a platform to deliver data, this according to a report from The New Stack and Lightbend.

There is a revival now that see developers being asked to "be a lot more 'data smart,'" said Lightbend CEO Mark Brewer.

He added that for the most interesting cases of future use—notably artificial intelligence and machine learning—streaming data is "table stakes," which paves for the increase in the number of programming languages, frameworks, and tools for developing and operating applications centered on data streaming, TechRepublic reports.

The tech news site adds that while many companies were faced with the challenge of finding developers that can handle complicated systems, these organizations still understand that streaming is the road to the future—regardless if they are prepared for it or not.

"Competitive pressure is driving organizations to embrace streaming data to extract useful information more quickly from incoming data, as well as to serve impactful results from artificial intelligence/machine learning to customers," said the New Stack-Lightbend report, which surveyed 800 information technology professionals.

The report added that the "always on" features of streaming avenues must deliver the same scalability, resiliency, and efficiency as that of micro-services. This explains the popularity of mature solutions, such as Akka Streams, since they have the capacity to bridge that gap.

Moreover, the survey also found a jump in the number of companies that process data in real time for AI or ML—from 2017's six percent to 33 percent this year. There was also an increase in real-time data processing used for Internet of Things (IoT) devices, which the report said would only advance if such devices increase in popularity and are made to be more accommodating to more kinds of content.

Developers are able to meet this demand, as their skill levels improve with the increase for the demand of more complicated micro-services and streaming systems.