Skip to content

[CH] Crash on exit with Poco exception #5744

Closed
@zhanglistar

Description

Backend

CH (ClickHouse)

Bug description

Log is:

2024/05/14 16:27:30,975 INFO [dispatcher-Executor] JniLibLoader: Library /data9/hadoop/yarn/local/usercache/xumingyong/appcache/application_1710462985812_739851/container_e57_1710462985812_739851_01_000015/./libch.so has been loaded using path-loading method
2024-05-14 16:27:31.236 <Information> ClickHouseBackend: Init environment variables.
2024-05-14 16:27:31.238 <Debug> CHUtil: Set settings from config key:spark.gluten.sql.columnar.backend.ch.runtime_config.local_engine.settings.log_processors_profiles value:true
2024-05-14 16:27:31.238 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.input_format_orc_row_batch_size value:10000
2024-05-14 16:27:31.238 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.join_algorithm value:grace_hash
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.max_block_size value:8192
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.max_bytes_before_external_group_by value:1610612736
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.max_bytes_before_external_sort value:1073741824
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.max_bytes_in_join value:1073741824
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.max_memory_usage value:3221225472
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.max_threads value:1
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.output_format_orc_compression_method value:snappy
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.query_plan_enable_optimizations value:false
2024-05-14 16:27:31.239 <Debug> CHUtil: Set settings key:spark.gluten.sql.columnar.backend.ch.runtime_settings.short_circuit_function_evaluation value:force_enable
2024-05-14 16:27:31.239 <Information> ClickHouseBackend: Init settings.
2024-05-14 16:27:31.239 <Debug> Context: Setting up /data9/hadoop/yarn/local/usercache/xumingyong/appcache/application_1710462985812_739851/container_e57_1710462985812_739851_01_000015/tmp/libch/ to store temporary data in it
2024-05-14 16:27:31.239 <Information> ClickHouseBackend: Init shared context and global context.
2024-05-14 16:27:31.239 <Information> ClickHouseBackend: Apply configuration and setting for global context.
2024-05-14 16:27:31.239 <Warning> SignalHandler: LD_PRELOAD is not set, SignalHandler is disabled
2024-05-14 16:27:31.239 <Information> ClickHouseBackend: Register read buffer builders.
2024-05-14 16:27:31.239 <Information> ClickHouseBackend: Register relation parsers.
2024-05-14 16:27:31.248 <Information> ClickHouseBackend: Register all functions.
2024-05-14 16:27:31.248 <Information> ClickHouseBackend: Register all factories.
2024-05-14 16:27:31.248 <Information> ClickHouseBackend: Init compiled expressions cache factory.
2024/05/14 16:27:31,269 INFO [dispatcher-Executor] ExecutorPluginContainer: Initialized executor component for plugin org.apache.gluten.GlutenPlugin.
2024/05/14 16:27:31,272 INFO [dispatcher-GlutenExecutorEndpoint] GlutenExecutorEndpoint: Initialized GlutenExecutorEndpoint.
2024/05/14 16:27:40,979 ERROR [SIGTERM handler] CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
2024/05/14 16:27:41,080 INFO [shutdown-hook-0] MemoryStore: MemoryStore cleared
2024/05/14 16:27:41,081 INFO [shutdown-hook-0] BlockManager: BlockManager stopped
2024/05/14 16:27:41,098 INFO [shutdown-hook-0] ShutdownHookManager: Shutdown hook called
libc++abi: terminating due to uncaught exception of type Poco::SystemException: System exception

Spark version

Spark-3.3.x

Spark configurations

No response

System information

No response

Relevant logs

No response

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions