Given users(user_id, name), keep rows where length(name) >= 4, add a column name_upper = upper(name), drop name. Sort by user_id asc.
These DataFrames are passed to solve(spark, dfs). Access one with dfs['name'].
users10 rows| user_id (int) | name (string) |
|---|---|
| 1 | Zara |
| 2 | Xi |
| 3 | Mira |
| 4 | Riya |
| 5 | Mira |
| 6 | Aryan |
| 7 | Aarav |
| 8 | Isha |
| 9 | Vivaan |
| 10 | Ishaan |
Column names and order must match. Sort order is specified in the question.