InterviewSolution
Saved Bookmarks
InterviewSolution
| 1. |
What is schema evolution? |
|
Answer» One set of data can be KEPT in several files with various yet compatible schemas with schema evolution. The Parquet data source in Spark can automatically recognize and merge the schema of those files. Without automatic schema merging, the most COMMON method of dealing with schema evolution is to reload PAST data, which is time-consuming. |
|