While browsing the CNCF Serverless Slack channel recently, I noticed a message; someone needed help writing a function which processes S3 update events. He didn’t want to use AWS Lambda and alternatively was looking for an open-source solution over Kubernetes. I took on the challenge of writing, as a response, a function for the open…
More than a decade has passed since we coined the term “big data,” and a decade in the tech world is almost infinity. Is big data now obsolete? The short answer is that although big data in itself may still have its place for some apps, the focus has shifted to integrating data-driven insights into…
iguazio’s Yaron Haviv and Microsoft’s Tomer Rosenthal provide an overview of serverless architectures and the efforts to encourage collaboration and portability through CNCF working groups. Skip to minute 38:54 for a demo of nuclio on Azure.
The amount of new technologies in 2017 has been overwhelming: The cloud was adopted faster than analysts projected and brought several new tools with it; AI was introduced into just about all areas of our lives; IoT and edge computing emerged; and a slew of cloud-native technologies came into fruition, such as Kubernetes, serverless, and…
We recently debated at a technical forum what cloud native storage is, which led me to believe that this topic deserves a deeper discussion and more clarity. First though, I first want to define what cloud native applications are, as some may think that containerizing an application is enough to make it “cloud-native.” This is…
Watch this video of Yaron Haviv talking about using serverless in Big Data and AI. Yaron spoke at a Meetup which was part of the NYC Database Month series in November 2017:
AWS re:Invent is all about how managed data services, serverless, and AI work together to enable new business applications. The focus is shifting from building the infrastructure of your choice in a playground that has an endless number of toys (services) to an opinionated, pre-packaged approach that enables customers to focus on business applications. Why? Businesses are aligning with the…
Serverless platforms allow developers to focus on building and running auto-scaling applications without worrying about managing servers, as server provisioning and maintenance are taken care of behind the scenes. Industry demand for instant results has therefore made serverless platforms the new buzz. However, serverless platforms have challenges which limit their usability and applicability: Slow performance…
We’ve gotten used to there always being a trade-off: if something is abstract and easy to use as serverless, it’s probably slow and inflexible. Either that, or we’ve had to squeeze maximum performance and address unique application requirements at the expense of usability. But nuclio’s serverless functions (https://github.com/nuclio/nuclio) lets us rapidly create and run…
I used to be sure OpenStack would take over VMware. Five years ago, when I worked on OpenStack, I felt freedom – users could manage the entire cluster as a cloud and say goodbye to $5,000 fees per license. However, in hindsight VMware hasn’t been cannibalized by OpenStack or by the public cloud. It is…
Today we announced a $33M investment from top VCs – Verizon Ventures, Robert Bosch Venture Capital, CME Ventures and Dell Technologies Capital. It’s a major step in our ambitious goal of accelerating digital transformation by enabling modern cloud and analytical services close to the edge. iguazio simplifies the data stack and enables organizations to automate…
Last week I sat in on an AWS event in Tel Aviv. I didn’t hear a single word about infrastructure or IT and nothing about VMs or storage, either. It was all about developers and how they can build production grade solutions faster, at a fraction of the cost, while incorporating Amazon’s latest security, AI…
Cloud and SaaS companies invented the notion of micro-services and the “cloud-native” model to gain efficient scaling along with continuous development and operations. Legacy approaches don’t work for global services like Facebook, Google or eBay, which are always on. Containers and Docker were created as the ultimate packaging for such micro-services and new orchestration platforms…
iguazio combines real-time analytics, concurrent processing and cloud-native agility. We started working on this completely new approach to data management after witnessing countless customers struggle with traditional big data and analytics solutions. As a result, we are seeing that iguazio’s platform leads to magnitudes faster time to insights, faster time to market, greater simplicity and…
Earlier this week, a significant portion of the internet was down due to an Amazon Web Services’ (AWS) S3 outage. While AWS blames the problem on the removal of a couple of servers, the real question is why have we created such a dependency on services like AWS? Won’t it get worse with the coming…
Serverless computing is the latest buzz, driven by the digital economy’s demand for instant results without the hassle. The serverless concept is a prepacked flavor of modern cloud-native architecture which decomposes applications to multiple stateless and elastic micro-service tiers. Micro-services shrink or grow to satisfy demand; they are restarted in case of a resource failure…
The IT industry is still in flux and in 2016 we saw some tectonic shifts. Setting aside noise and hype, lets analyze the trends and predict what will likely happen in 2017. Rapid Growth of Enterprise Cloud Adoption It doesn’t take a prophet to notice the public cloud is growing and Enterprise IT is shrinking.…
After this week at re:invent, it is clear that Amazon is unstoppable. AWS announced many more products, all fully integrated and simple to use and if you thought infrastructure companies are its competition, think again. The new Amazon offering competes with established database vendors, the open-source big data eco-system and container eco-system, security software and…
Placing Governed Data and Analytics Closer to Their Sources, While Leveraging Amazon Web Services Compute Elasticity to Generate Business Insights at Extreme High Speeds AWS re:invent, Las Vegas, NV, November 30th, 2016 iguazio today announced that it is collaborating with Equinix (Nasdaq: EQIX) to power the Equinix Data Hub, enabling a critical advantage for the…
Last month Amazon and VMware announced a partnership which will enable VMware software to run on a dedicated space within Amazon cloud. This unnatural act is mainly due to Azure which is getting stronger, it is the only cloud provider with a real hybrid cloud story. The same exact software stack which was initially limited…
iguazio announced its revolutionary Enterprise Data Cloud platform on September 27th, designed with a modern approach from the ground-up. iguazio’s platform serves millions of requests per second, scaling to petabytes and managed as a PaaS with extreme simplicity. We built an end to end IoT application for monitoring and controlling smart connected cars to demonstrate…
Legacy data management didn’t offer the scalability one finds in Big Data or NoSQL, but life was simple. You’d buy storage from your vendor of choice, add a database on top and use it for all your workloads. In the new world, however, there are data services for every application workload. Targeted services may sound…
The software world is rapidly transitioning to agile development using micro-services and cloud-native architectures. And there’s no turning back for companies that want to be competitive in the new digital transformation. Evolution in the application space has a significant impact on the way we build and manage infrastructure. Cloud-native applications in particular require shared cloud-native…
During the last decades, The IT industry have used and cultivated the same storage and data management stack. The problem is, everything around those stacks changed from the ground up — including new storage media, distributed computing, NoSQL, and the cloud. Combined, those changes make today’s stack exceedingly inefficient — slowing application performance, creating huge…
Containers are getting widely adopted as they simplify the application development and deployment process, the transition into continuous integration with Microservices and Cloud-Native architectures will have significant impact on the businesses agility and competitiveness- They bring the notion of Smartphone Apps to the datacenter. Unfortunately, today there are still gaps, and Cloud-Native implementations require quite…
Big Data used to be about storing unstructured data in its raw form – . “Forget about structures and Schema, it will be defined when we read the data”. Big Data has evolved since – The need for Real-Time performance, Data Governance and Higher efficiency is forcing back some structure and context. Traditional Databases have…
Major changes are happening in storage media hardware – Intel announced a 100X faster storage media, way faster than the current software stack. To make sure the performance benefits are evident, they also provide a new block storage API kit (SPDK) bypassing the traditional stack, so will the current stack become obsolete? Some background on…
Enterprise IT is on the verge of a revolution, adopting hyper-scale and cloud methodologies such as Micro-services, DevOps and Cloud-Native. As you might expect the immediate reaction is to try and apply the same infrastructure, practices and vendor solutions to the new world, but many solutions and practices are becoming irrelevant, SAN/VSAN and NAS among…
BigData is quite new, yet when we examine the common solutions and deployment practices it seems like we are going backwards in time. Manual processes, patches of glue logic and partial solutions, wasted resources and more … are we back in the 90’s? Can we build it more efficiently to address real-world business challenges? Some Background First…