What changes were proposed in this pull request?

Adds an options to automatically clean temp data after job is finished. Option: config.enableRequestCleaner , false by default.

Usage:

LOAD Rest.`http://www.byzer.org/`
WHERE `config.connect-timeout`="10s"
AND `config.page.next`= "http://www.byzer.org/index={0}"
AND `config.method`="get"
AND `config.page.retry`="1"
AND `config.page.values`="offset:0,1"
AND `header.content-type`="application/json"
ANd `config.debug`="true"
AND `config.enableRequestCleaner`="true"
AS dd;

How was this patch tested?

Added a ut case: Temp data should be cleaned if config.enableRequestCleaner is true. unit test passed.

Are there and DOC need to update?

• Will update mlsql-docs repo

Spark Core Compatibility