Notebook: Pyspark3 links incorrectly mapped when AD enabled #6845
Closed
Description
opened on Aug 21, 2019
Issue Type: Bug
Connect to a big data cluster with AD enabled and run print (1)
on PySpark3. You'll get the Spark UI and DriverLog UI links, but they're broken.
E.g. Spark UI is https://mssql.azdata.local%2C31433:30433/gateway/default/yarn/proxy/application_1566354222136_0001/
It should be using the hdfs URL instead of mssql, in which case it would be (for me, with hdfs as the gateway DNS name)
https://hdfs.azdata.local:30433/gateway/default/yarn/proxy/application_1566354222136_0001/
Azure Data Studio version: azuredatastudio 1.11.0 (9ca6200, 2017-12-15T12:00:00.000Z)
OS version: Darwin x64 18.7.0
System Info
Item | Value |
---|---|
CPUs | Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz (12 x 2600) |
GPU Status | 2d_canvas: enabled flash_3d: enabled flash_stage3d: enabled flash_stage3d_baseline: enabled gpu_compositing: enabled multiple_raster_threads: enabled_on native_gpu_memory_buffers: enabled oop_rasterization: disabled_off protected_video_decode: unavailable_off rasterization: enabled skia_deferred_display_list: disabled_off skia_renderer: disabled_off surface_synchronization: enabled_on video_decode: enabled viz_display_compositor: disabled_off webgl: enabled webgl2: enabled |
Load (avg) | 2, 2, 2 |
Memory (System) | 16.00GB (0.32GB free) |
Process Argv | . |
Screen Reader | no |
VM | 0% |
Extensions (2)
Extension | Author (truncated) | Version |
---|---|---|
ads-language-pack-es | Mic | 1.9.0 |
sql-vnext | Mic | 0.14.1 |
Activity