Saved Bookmarks
| 1. |
What Makes Apache Spark Good At Low-latency Workloads Like Graph Processing And Machine Learning? |
|
Answer» Apache Spark stores data in-memory for faster model building and training. Machine learning algorithms require multiple ITERATIONS to generate a resulting optimal model and similarly graph algorithms traverse all the nodes and edges. These low latency WORKLOADS that NEED multiple iterations can lead to increased performance. Less disk access and controlled NETWORK traffic make a huge DIFFERENCE when there is lots of data to be processed. Apache Spark stores data in-memory for faster model building and training. Machine learning algorithms require multiple iterations to generate a resulting optimal model and similarly graph algorithms traverse all the nodes and edges. These low latency workloads that need multiple iterations can lead to increased performance. Less disk access and controlled network traffic make a huge difference when there is lots of data to be processed. |
|