/ Posts / Pomerol Partners and StreamSets: Traditional ETL Is Dead. All Hail DataOps!
Pomerol Partners and StreamSets: Traditional ETL Is Dead. All Hail DataOps!
on November 21, 2019
Pomerol Partners is now a proud partner of StreamSets, the industry’s first multi-cloud DataOps platform for modern data integration. The StreamSets solution suite addresses needs from IoT to Cybersecurity to Customer 360 and more. It overcomes the brittleness of traditional data integration tools, which were designed when data movement was simple and static. Today’s fluid world requires a platform that supports agility.
Initially created as a new way of moving data based on the assumption of continuous data and frequent change, the StreamSets DataOps platform enables agile design and operation of continuous data movement architectures that connect traditional and big data sources to analytics platforms and applications. At the heart of DataOps is the StreamSets Data Collector, which is an open source data movement engine with over two million downloads. StreamSets also enlists commercial products that enable collaborative design, deployment and runtime management of data movement architectures at enterprise scale.
Pomerol Partners is excited to partner with StreamSets and the DataOps platform enabling continuous dataflows that unleash extensive intelligence. Key features of the platform include executing from edge to cluster to cloud, dataflow automation and monitoring, data SLAs for performance management and intelligence pipelines for data drift. The agile platform is built on an open source core that allows developers to design pipelines with a minimum amount of code and the ability to aggregate numerous dataflows into topologies. The operators can manage the topologies centrally with live visibility, SLA-based performance and in-stream data protection.
The StreamSets partnership better enables Pomerol Partners to help their clients with use cases including: Hybrid Cloud, Data Lake, Apache Kafka, Cybersecurity, Internet Of Things (IoT), Customer 360, Streaming Applications, and, Data Privacy (GDPR, HIPAA). The open source Data Collector is used for the execution for any-to-any data pipelines. Control Hub provides a cloud-native environment for design, deployment, monitoring and maintenance of data movement architectures. Dataflow Performance Manager (DPM™) offers advanced management of dataflows by adding historical comparisons and Data SLAs for availability, accuracy and security to Control Hub implementations. Data Protector™ aids compliance with GDPR, HIPAA and other regulations; StreamSets Data Protector discovers and secures sensitive data “in-flight”, as it arrives from a source or moves between compute platforms.
StreamSets: StreamSets built the industry’s first multi-cloud DataOps platform for modern data integration, helping enterprises to continuously flow big, streaming and traditional data to their data scientists and data-intensive applications. It uniquely handles data drift, those frequent and unexpected changes to data that break pipelines and damage data integrity. Founded in 2014 by Girish Pancha, former chief product officer of Informatica, and Arvind Prabhakar, a former engineering leader at Informatica and Cloudera, StreamSets is backed by top-tier Silicon Valley venture capital firms, including Battery Ventures, New Enterprise Associates (NEA), and Accel Partners. For more information, visit https://us.pomerolpartners.com/products/streamsets/ .
Pomerol Partners: Pomerol Partners is a data focused consultancy with offices in the United States, United Kingdom and South Africa. Approaching challenges from a business point of view instead of from an IT point of view allows Pomerol Partners to solve business problems with an end to end solution of disruptive technologies – Qlik, Couchbase, Data Robot, Big Squid, Lavastorm & Blockchain. Pomerol Partners delivers business critical data solutions in a timely and scalable manner that drives unparalleled efficiency improvements throughout client organizations. For more information, visit https://us.pomerolpartners.com/products/streamsets/.
