Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to connect to spark-master:7077 in spark-worker #54

Open
vutrungduc7593 opened this issue Oct 3, 2018 · 2 comments
Open

Failed to connect to spark-master:7077 in spark-worker #54

vutrungduc7593 opened this issue Oct 3, 2018 · 2 comments

Comments

@vutrungduc7593
Copy link

Hello.
I found this error in spark-worker container logs.
Can you give me some advice to fix it?
Thank you.

Caused by: java.io.IOException: Failed to connect to spark-master/172.22.0.8:7077
        at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:228)
        at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:179)
        at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:197)
        at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:191)
        at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:187)
        ... 4 more
Caused by: java.net.ConnectException: Connection refused: spark-master/172.22.0.8:7077
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:224)
        at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:289)
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
        at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
        ... 1 more
@pomadchin
Copy link
Member

How to reproduce this behaviour and what do you do?

@vutrungduc7593
Copy link
Author

I solved it by changing the command from

spark-master:
        command:
            - ./sbt
            - runMain geotrellis.chatta.Main

to

spark-master:
        command: master

Then I bound ./data directory to spark-worker's volumes

spark-worker:
        volumes:
          - "./data:/data"

Then I submitted to spark cluster with --master URL like

ingest-geodocker: server/${JAR}
	docker-compose -f docker-compose.yml exec spark-master \
		spark-submit \
		--master spark://a8dfe940b6a5:7077\
		--class chatta.ChattaIngest \
		${JAR} \
		--input "file:///server/conf/input.json" \
		--output "file:///server/conf/output.json" \
		--backend-profiles "file:///server/conf/backend-profiles.json"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@pomadchin @vutrungduc7593