Spark + AI Summit 2020: WASAI Talks on Optimizing Spark Performance with Apache Arrow and Intel FPGA

TAIPEI, TAIWAN, Jul. 31, 2020 – WASAI Technology gave a talk at Spark+AI Summit 2020 in the last month. The organizer, Databricks, mentioned that this very first online virtual activity drawing about 60,000 professionals around the world to participate. CEO of WASAI, Calvin Hung and a senior engineer of Intel Wei-Ting Lin demonstrated the result of “Accelerating Spark SQL workloads to 50x performance with Apache arrow-based FPGA acceleration” at 6:40 am June 24, 2020, Taipei time.


While in speech, Calvin pointed out that ” Spark SQL essentially processes structured row-based dataset at once with single query of a bunch of SQL operators. The operators can be simple while the dataset could be extremely large. FPGA with highly specialized IPs can deal with such multiple-instruction, single-dataset analysis faster, more power- and resource-efficient than CPU and GPU do under the same total-cost-of-ownership. ”

WASAI Technology and Intel work closely on leveling up the performance of Spark. The end target is to provide end-to-end columnar data processing with FPGA integration and acceleration to avoid heavy CPU-intensive operations. Wei-Ting Chen, the senior engineer of Intel, mentioned that Intel also provides Spark Optimized Analytics Packages Native SQL Engine, and will collaborate with WASAI on developing FPGA-accelerated OAP Native SQL Engine for Spark.


To see the full video:

#Event #Virtual #BigData #FPGAComputing #Spark



About WASAI Technology Inc.

WASAI Technology's mission is to deliver acceleration technologies of High-Performance Data Analysis (HPDA) in future data centers for targeted vertical applications with massive volumes and high velocities of scientific data. To strengthen and advance scientific discovery and technological research via big data-intensive acceleration in high-performance computing, WASAI Technology aims to improve commercialization and commoditization of scientific and technological applications.

​​###

WASAI Tecnology Inc.

10846

4F., No.66, Sec. 2, Changsha St., Wanhua Dist., Taipei City 108, Taiwan (R.O.C.)

wasai@wasaitech.com

WASAI Technology Inc. specializes in Big Data acceleration platforms, provides expert patented solutions to key problems for large data centers with both high quality and performance.


Founded in 2015.

Quick Map

Home


Product

Solution

About

Contact


Events

Career

Contact Info

USA Office:

4604 Roseville Rd., North Highlands, CA 95660

8000 Edgewater Drive, Oakland, CA 94621

Asia Office:

4F, No.66, Sec.2, Changsha St., Taipei 10848, Taiwan

Email:

wasai@wasaitech.com

  • LinkedIn
  • Twitter
  • Facebook
  • YouTube

© 2019 WASAI Technology, Inc. All rights reserved.