Multinational Software Corporation Utilizes FPGAs to Optimize Columnar Data Compression for Efficient Data Processing

A multinational software corporation developed enterprise software to help businesses manage operations and customer relations. One management system they develop encodes columnar data with dictionaries, compressed to meet memory requirements. However, existing compression algorithms were either inefficient or ineffective. To solve these issues, they employed field-programmable gate arrays (FPGAs) with parallel processing capabilities to execute the Re-Pair compression algorithm quickly and with little power consumption.

They utilized the Linux OS and high-performance PCI Express (PCle)-based FPGA acceleration cards to make it easier to deploy and move applications from one server to another without additional effort. To optimize the FPGA-based solution, they adopted -  a software architecture to program FPGAs more efficiently and the H3 composable FPGA solution to expand the scale of FPGA resources. By tailoring the PCIe expansion system to their specific needs using Falcon 4210 expansion boxes and 24 FPGAs connected by PCIe Gen 4 switches, they successfully accelerated real-time data processing and met enterprise customer expectations.

Finally, they conveyed their appreciation to H3 for the dependable performance, well-built design, and user-friendly management interface and functionalities of the PCIe composable solution. This proof-of-concept (PoC) will help them plan the deployment of FPGA-based solutions in production environments, thus expediting the development time.

For more information about FPGA expansion technology, welcome contacting H3's composable infrastructure professional for further elaboration.