omniture

Tencent Cloud Breaks Four World Records at 2016 Sort Benchmark

Annual computing Olympics sees Tencent team sort 100TB of data in less than 99 seconds breaking previous best by AliCloud
Tencent
2016-11-11 08:00 2697

BEIJING, Nov. 11, 2016 /PRNewswire/ -- Tencent Cloud is pleased to announce that it has set four new world records in the 2016 Sort Benchmark competition, which is seen as the annual worldwide computing Olympics. The team spent less than 99 seconds (98.8 seconds) to complete sorting of 100 terabytes of data, breaking AliCloud's record of 329 seconds set last year. In past competitions, Baidu and Hadoop had set the records of 716 seconds and 4222 seconds respectively. 

The winning team was formed by Tencent Cloud and Tencent's Data Platform Department, which is responsible for big data technology and application management. The team set new records in winning both the GraySort and MinuteSort benchmarks with the Tencent Cloud Intelligent Distributed Computing Platform. Tencent Cloud outperformed the best speeds from the 2015 competition by two to five times.

Past records in Global Big Data Performance
Past records in Global Big Data Performance

Each year, top global companies and academic institutions participate in the Sort Benchmark contest to evaluate the capability of their software and hardware system architectures, as well as their research achievements. Tencent Cloud participated in two of the four competition categories, GraySort and MinuteSort, where architecture capabilities and computing efficiencies of large distributed computing systems and real time data analytics are evaluated. The GraySort and MinuteSort benchmarks are each measured in two sub categories:

  • Indy (special purpose sort)
  • Daytona (general purpose sort)

The Tencent Cloud Intelligent Distributed Computing Platform won all of the four sub categories above and outperformed AliCloud's record last year by a factor of two to five times.

The objective of the GraySort challenge is to sort 100TB, a total of 1 trillion unordered 100 byte records in ascending order in minimal amount of time. The Tencent Cloud Intelligent Distributed Computing Platform took 98.8 seconds to sort 100TB of data, which is equal to a sort rate of 60.7TB per minute. Last year's winner, AliCloud held the previous record of 18.2TB/min. The MinuteSort challenge focuses on sorting as much data as possible within one minute. AliCloud achieved a record of 11TB/min last year and Tencent Cloud's result was 55TB/min, which surpassed AliCloud's result by 5 times.  

Sort Benchmark World Records Comparison
Sort Benchmark World Records Comparison

Sortbenchmark.org uses the most fundamental computing method to evaluate distributed system software architectural capabilities such as distributed storage of massive data, task scheduling, node communication synchronization, and data exchange to monitor disasters. It also evaluates hardware architectural capabilities, including server selection and match, network architecture optimization, and the ability to build Internet Data Centers. The ultimate goal is to measure the full extent of a company's or organization's capabilities in large-scale computing. In the competition, Tencent Cloud leveraged 512 IBM OpenPOWER servers and 100Gb interconnect technology from Mellanox, improving the performance of its big data products.

"The global computing industry is now entering an era where enterprise data and social data are fully integrated," said Zeus Jiang, Vice President of Tencent Cloud and General Manager of Tencent's Data Platform Department. "In the near future, the ability to manage big data will be fundamental to the success of Internet businesses. Leveraging Tencent's 18 years of data processing ability, Tencent Cloud will continue to provide high performance computing to help businesses create core competitive edge while using minimal time and resource."

Built upon Tencent Cloud's hands-on experience in processing huge volumes of data on the Internet, and combined with the Hadoop ecosystem and self-developed component services, Tencent Cloud Intelligent Distributed Computing Platform has become a one-stop data analytics and data mining platform that is widely used by governments, traditional enterprises and Internet companies.

About Sort Benchmark: http://sortbenchmark.org/

About Tencent Cloud

Tencent Cloud is a leading global cloud service provider. A product of Tencent, Tencent Cloud was built with the expertise of teams who created such innovative services as QQ, WeChat and Qzone. Tencent Cloud provides integrated cloud services including IaaS, PaaS and SaaS, and has become a one-stop service for enterprises seeking to adopt public cloud, hybrid cloud, private cloud and cloud-based financial services. As a pioneer in cutting-edge web technologies such as Cloud Image, facial recognition, big data analytics, machine learning, audio/video technology and security protection, Tencent Cloud delivers integrated industry solutions for gaming, finance, e-commerce, tourism, online-to-offline services, governments, healthcare, online education, and smart hardware. It also provides general solutions with different functions, including online video, website set-up, hybrid cloud, big data, WeChat ecosystem and etc.

Photo: http://photos.prnewswire.com/prnh/20161110/437845-INFO
Photo: http://photos.prnewswire.com/prnh/20161110/437844-INFO

Source: Tencent
collection