0
我跑样的火花作业运行在Ubuntu 16.10无法找到在Mesos，主剂通过Mesos群集（1个主站，2个药膏）
Mesos，主UI的代理标签我看不到任何资源分配为特定的代理。添加新代理时，我在Masters日志中看不到任何确认。
主日志
[15:58:25 master.cpp:4836] Processing DECLINE call for offers: [ e9377bc9-92a2-47bd-b12b-1525c1233371-O786 ] for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:27 http.cpp:1115 ] HTTP GET for /master/state?jsonp=angular.callbacks._8 from 192.168.1.237:54674 with User-Agent='Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:54.0) Gecko/20100101 Firefox/54.0'
[15:58:28 master.cpp:7305] Sending 1 offers to framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:28 master.cpp:4836] Processing DECLINE call for offers: [ e9377bc9-92a2-47bd-b12b-1525c1233371-O787 ] for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:29 http.cpp:1115 ] HTTP GET for /master/state?jsonp=angular.callbacks._a from 192.168.1.237:54674 with User-Agent='Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:54.0) Gecko/20100101 Firefox/54.0'
[15:58:30 master.cpp:7305] Sending 1 offers to framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:30 master.cpp:4836] Processing DECLINE call for offers: [ e9377bc9-92a2-47bd-b12b-1525c1233371-O788 ] for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:33 master.cpp:7305] Sending 1 offers to framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:33 master.cpp:4836] Processing DECLINE call for offers: [ e9377bc9-92a2-47bd-b12b-1525c1233371-O789 ] for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:34 http.cpp:1115 ] HTTP GET for /master/state?jsonp=angular.callbacks._c from 192.168.1.237:54674 with User-Agent='Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:54.0) Gecko/20100101 Firefox/54.0'
[15:58:35 http.cpp:1115 ] HTTP GET for /master/state?jsonp=angular.callbacks._6 from 192.168.1.237:54674 with User-Agent='Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:54.0) Gecko/20100101 Firefox/54.0'
[15:58:35 master.cpp:7305] Sending 1 offers to framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:35 master.cpp:4836] Processing DECLINE call for offers: [ e9377bc9-92a2-47bd-b12b-1525c1233371-O790 ] for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:37 http.cpp:1115 ] HTTP GET for /master/state?jsonp=angular.callbacks._a from 192.168.1.237:54674 with User-Agent='Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:54.0) Gecko/20100101 Firefox/54.0'
[15:58:38 master.cpp:7305] Sending 1 offers to framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:38 master.cpp:4836] Processing DECLINE call for offers: [ e9377bc9-92a2-47bd-b12b-1525c1233371-O791 ] for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 (wordCount) at [email protected]:42131
[15:58:39 http.cpp:1115 ] HTTP GET for /master/state?jsonp=angular.callbacks._c from 192.168.1.237:54674 with User-Agent='Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:54.0) Gecko/20100101 Firefox/54.0'
[15:58:40 master.cpp:6990] Performing explicit task state reconciliation for 1 tasks of framework 417e3708-25d8-46fd-9896-51bcdb750f03-0
从日志
Failed to fetch '/usr/local/spark-2.1.0-bin-hadoop2.7': Failed to copy '/usr/local/spark-2.1.0-bin-hadoop2.7': exited with status 1
End fetcher log for container 11ab854c-590e-49da-937b-e5dd5084f36e
[fetcher.cpp:558] Failed to run mesos-fetcher: Failed to fetch all URIs for container '11ab854c-590e-49da-937b-e5dd5084f36e' with exit status: 256
[slave.cpp:5048] Container '11ab854c-590e-49da-937b-e5dd5084f36e' for executor '1' of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 failed to start: Failed to fetch all URIs for container '11ab854c-590e-49da-937b-e5dd5084f36e' with exit status: 256
[containerizer.cpp:2102] Destroying container 11ab854c-590e-49da-937b-e5dd5084f36e in FETCHING state
[linux_launcher.cpp:505] Asked to destroy container 11ab854c-590e-49da-937b-e5dd5084f36e
[linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/11ab854c-590e-49da-937b-e5dd5084f36e
[cgroups.cpp:2692] Freezing cgroup /sys/fs/cgroup/freezer/mesos/11ab854c-590e-49da-937b-e5dd5084f36e
[cgroups.cpp:1405] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/11ab854c-590e-49da-937b-e5dd5084f36e after 2.626816ms
[cgroups.cpp:2710] Thawing cgroup /sys/fs/cgroup/freezer/mesos/11ab854c-590e-49da-937b-e5dd5084f36e
[cgroups.cpp:1434] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/11ab854c-590e-49da-937b-e5dd5084f36e after 2.189056ms
[containerizer.cpp:2508] Container 11ab854c-590e-49da-937b-e5dd5084f36e has exited
[slave.cpp:5168] Executor '1' of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 exited with status 1
[slave.cpp:4215] Handling status update TASK_FAILED (UUID: adad1443-e464-462f-b199-7f5545c30ba9) for task 1 of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 from @0.0.0.0:0
[containerizer.cpp:1917] Ignoring update for unknown container 11ab854c-590e-49da-937b-e5dd5084f36e
[status_update_manager.cpp:323] Received status update TASK_FAILED (UUID: adad1443-e464-462f-b199-7f5545c30ba9) for task 1 of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000
[slave.cpp:4655] Forwarding the update TASK_FAILED (UUID: adad1443-e464-462f-b199-7f5545c30ba9) for task 1 of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000 to [email protected]:5050
[status_update_manager.cpp:395] Received status update acknowledgement (UUID: adad1443-e464-462f-b199-7f5545c30ba9) for task 1 of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000
[slave.cpp:5268] Cleaning up executor '1' of framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000
[gc.cpp:55] Scheduling '/var/lib/mesos/slaves/4e98bf77-8b4a-43ab-a79b-12b63c1b18df-S3/frameworks/e9377bc9-92a2-47bd-b12b-1525c1233371-0000/executors/1/runs/11ab854c-590e-49da-937b-e5dd5084f36e' for gc 6.99998930747556days in the future
[slave.cpp:5356] Cleaning up framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000
[gc.cpp:55] Scheduling '/var/lib/mesos/slaves/4e98bf77-8b4a-43ab-a79b-12b63c1b18df-S3/frameworks/e9377bc9-92a2-47bd-b12b-1525c1233371-0000/executors/1' for gc 6.99998930613333days in the future
[gc.cpp:55] Scheduling '/var/lib/mesos/slaves/4e98bf77-8b4a-43ab-a79b-12b63c1b18df-S3/frameworks/e9377bc9-92a2-47bd-b12b-1525c1233371-0000' for gc 6.99998930488593days in the future
[status_update_manager.cpp:285] Closing status update streams for framework e9377bc9-92a2-47bd-b12b-1525c1233371-0000
什么都在安装进行的更改..？
什么exacly是你的问题？你能显示屏幕来呈现什么是不正确的？可能没有代理分配，因为没有任务正在运行。 – janisz
这里有两件事情.. 1.当一个代理被添加到集群时，我看不到在主日志中有任何确认（如已经检测到新的代理或已添加了ip 192.xxx.x.xxx） 2.运行火花作业时无法获取并复制Executor.Uri .. 您能否建议我进行成功运行作业所需的更改。 – Abhishek