Our latest case study discusses the innovative technical solution to the challenges encountered by the customer in the development of an analytics solution for large datacenter network traffic.
The customer’s development team turned to R Systems for a proof of concept to overcome the challenge of the particularly large volume of information which needed to be stored by the system (up to 90% of 6 million information per minute for a “live period” of 10 days or the system’s limit of 5TB of information).
Our specialists undertook both a developer and consultant’s role in finding, proposing and building a viable solution to the customer’s challenge. After testing for several tools, R Systems experts proposed an inventive combination of technologies: Apache Kafka and Elasticsearch, with stream processing custom Java implementation based on Kafka Consumer Groups, and distributed stateless Java applications. The solution was successfully implemented by the customer and achieved the desired objectives, as well as high performance parameters in terms of ingestion speed, number of records inserted per second in Elasticsearch, number of concurrent users.
We are happy to have supported our customer’s development team as technical and consulting partner while putting into practice our solid expertise in the latest technologies, innovative approach and good understanding of the client’s business case.