Skip to content

Notebook: Pyspark3 links incorrectly mapped when AD enabled #6845

Closed
@kevcunnane

Description

Issue Type: Bug

Connect to a big data cluster with AD enabled and run print (1) on PySpark3. You'll get the Spark UI and DriverLog UI links, but they're broken.

E.g. Spark UI is https://mssql.azdata.local%2C31433:30433/gateway/default/yarn/proxy/application_1566354222136_0001/

It should be using the hdfs URL instead of mssql, in which case it would be (for me, with hdfs as the gateway DNS name)
https://hdfs.azdata.local:30433/gateway/default/yarn/proxy/application_1566354222136_0001/

Azure Data Studio version: azuredatastudio 1.11.0 (9ca6200, 2017-12-15T12:00:00.000Z)
OS version: Darwin x64 18.7.0

System Info
Item Value
CPUs Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz (12 x 2600)
GPU Status 2d_canvas: enabled
flash_3d: enabled
flash_stage3d: enabled
flash_stage3d_baseline: enabled
gpu_compositing: enabled
multiple_raster_threads: enabled_on
native_gpu_memory_buffers: enabled
oop_rasterization: disabled_off
protected_video_decode: unavailable_off
rasterization: enabled
skia_deferred_display_list: disabled_off
skia_renderer: disabled_off
surface_synchronization: enabled_on
video_decode: enabled
viz_display_compositor: disabled_off
webgl: enabled
webgl2: enabled
Load (avg) 2, 2, 2
Memory (System) 16.00GB (0.32GB free)
Process Argv .
Screen Reader no
VM 0%
Extensions (2)
Extension Author (truncated) Version
ads-language-pack-es Mic 1.9.0
sql-vnext Mic 0.14.1

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions