High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark

High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark

作者: Holden Karau Rachel Warren
出版社: O'Reilly
出版在: 2017-06-16
ISBN-13: 9781491943205
ISBN-10: 1491943203
裝訂格式: Paperback
總頁數: 358 頁





內容描述


Apache Spark is amazing when everything clicks. But if you haven’t seen the performance improvements you expected, or still don’t feel confident enough to use Spark in production, this practical book is for you. Authors Holden Karau and Rachel Warren demonstrate performance optimizations to help your Spark queries run faster and handle larger data sizes, while using fewer resources.Ideal for software engineers, data engineers, developers, and system administrators working with large-scale data applications, this book describes techniques that can reduce data infrastructure costs and developer hours. Not only will you gain a more comprehensive understanding of Spark, you’ll also learn how to make it sing.With this book, you’ll explore:How Spark SQL’s new interfaces improve performance over SQL’s RDD data structureThe choice between data joins in Core Spark and Spark SQLTechniques for getting the most out of standard RDD transformationsHow to work around performance issues in Spark’s key/value pair paradigmWriting high-performance Spark code without Scala or the JVMHow to test for functionality and performance when applying suggested improvementsUsing Spark MLlib and Spark ML machine learning librariesSpark’s Streaming components and external community packages




相關書籍

The Rails View: Create a Beautiful and Maintainable User Experience (Paperback)

作者 Bruce Williams John Athayde

2017-06-16

PowerQuery 實戰技巧精粹與 M語言|新世代 Excel BI 大數據處理

作者 王仲麒

2017-06-16

TQC+ 網頁設計認證指南 Dreamweaver CC, 2/e

作者 財團法人中華民國電腦技能基金會

2017-06-16