[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886830#comment-15886830 ] Deshi Xiao commented on MESOS-7151: --- [~mark1982] with my use case, i can't found any issue for this pailer ui. so i mostly want to check your fw's bug. if you can provide a mini fw to reproduce the bug, we can easily debug it asap. > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png, taskid=1292.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880814#comment-15880814 ] haosdent commented on MESOS-7151: - [~mark1982] Sorry, I could identify the problem according to your logs. May you mind use Teamviewer or Chrome remote to troubleshoot the problem? My hangout is haosd...@gmail.com > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png, taskid=1292.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880243#comment-15880243 ] Deshi Xiao commented on MESOS-7151: --- pailer can't support large log? > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png, taskid=1292.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877226#comment-15877226 ] mark1982 commented on MESOS-7151: - [~gilbert] you can refer the attachment [taskid=1292.png]. Sandbox in my directory is correct. > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png, taskid=1292.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877218#comment-15877218 ] mark1982 commented on MESOS-7151: - [~gilbert] below is my agent log. The log is belong to my another task(id= 1292) with the above problem 2) I saw nothing error in the agent log. --- WARNING: Logging before InitGoogleLogging() is written to STDERR I0221 22:45:49.842823 6155 main.cpp:243] Build: 2016-12-21 01:05:42 by root I0221 22:45:49.842937 6155 main.cpp:244] Version: 1.0.1 I0221 22:45:49.853807 6155 systemd.cpp:237] systemd version `219` detected I0221 22:45:49.853859 6155 main.cpp:342] Inializing systemd state I0221 22:45:49.854303 6155 systemd.cpp:304] Created systemd slice: `/run/systemd/system/mesos_executors.slice` I0221 22:45:49.897418 6155 systemd.cpp:325] Started systemd slice `mesos_executors.slice` I0221 22:45:50.955787 6155 containerizer.cpp:196] Using isolation: cgroups/devices,gpu/nvidia,filesystem/posix,network/cni I0221 22:45:50.961525 6155 linux_launcher.cpp:101] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@726: Client environment:zookeeper.version=zookeeper C client 3.4.8 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@730: Client environment:host.name=AliHPC-BJG41-102 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@737: Client environment:os.name=Linux 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@738: Client environment:os.arch=3.10.0-327.el7.x86_64 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@739: Client environment:os.version=#1 SMP Thu Nov 19 22:10:57 UTC 2015 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@747: Client environment:user.name=root 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@755: Client environment:user.home=/root 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@log_env@767: Client environment:user.dir=/disk1/prod/scripts 2017-02-21 22:45:50,974:6155(0x7f850c4d2700):ZOO_INFO@zookeeper_init@800: Initiating client connection, host=10.26.8.12:3183 sessionTimeout=1 watcher=0x7f851e202a4a sessionId=0 sessionPasswd= context=0x7f84b8000a90 flags=0 I0221 22:45:50.975133 6155 main.cpp:434] Starting Mesos agent 2017-02-21 22:45:50,975:6155(0x7f84f274c700):ZOO_INFO@check_events@1728: initiated connection to server [10.26.8.12:3183] 2017-02-21 22:45:50,977:6155(0x7f84f274c700):ZOO_INFO@check_events@1775: session establishment complete on server [10.26.8.12:3183], sessionId=0x15a6122843d0004, negotiated timeout=1 I0221 22:45:50.978123 6324 group.cpp:349] Group process (group(1)@10.26.8.12:5051) connected to ZooKeeper I0221 22:45:50.978163 6268 slave.cpp:198] Agent started on 1)@10.26.8.12:5051 I0221 22:45:50.978240 6324 group.cpp:837] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0221 22:45:50.978257 6324 group.cpp:427] Trying to create path '/mesos' in ZooKeeper I0221 22:45:50.978185 6268 slave.cpp:199] Flags at startup: --appc_simple_discovery_uri_prefix="http://; --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_environment_variables="{}" --executor_registration_timeout="1mins" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/mesos/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_command_executor="false" --image_provisioner_backend="copy" --initialize_driver_logging="true" --isolation="cgroups/devices,gpu/nvidia" --launcher_dir="/disk1/software/mesos-1.0.1/build/src" --logbufsecs="0" --logging_level="INFO" --master="zk://10.26.8.12:3183/mesos" --nvidia_gpu_devices="[ 0, 1 ]" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect"
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877043#comment-15877043 ] Gilbert Song commented on MESOS-7151: - [~mark1982], are you able to see any error from the agent log? Also, are you able to find contents from your stdout/stderr in the sandbox if just cd to that directory (not just from the UI)? > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875575#comment-15875575 ] haosdent commented on MESOS-7151: - the file you show is stderr or stdout in screnshot-6? > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875573#comment-15875573 ] mark1982 commented on MESOS-7151: - [~haosd...@gmail.com] There is nothing error in it. you can look at my attachment of [screenshot-6]. > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png, screenshot-6.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875557#comment-15875557 ] mark1982 commented on MESOS-7151: - I customized the framework using java-sdk. In my workflow, I set my task id for each task loaded. > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875556#comment-15875556 ] haosdent commented on MESOS-7151: - may you mind "Right click" -> "Inspect" -> "Click Console" in Chrome and show the error? > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, > screenshot-4.png, screenshot-5.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875481#comment-15875481 ] haosdent commented on MESOS-7151: - It sounds like {{pailer}} have problem when fetching the log. Do you see any error log in Chrome console? > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (MESOS-7151) Some stdout and stderr was disappeared. And some stdout can not fully display in webui.
[ https://issues.apache.org/jira/browse/MESOS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875447#comment-15875447 ] mark1982 commented on MESOS-7151: - mesos version: 1.0.1 master: run in docker. agent: run in host machine. os: linux. [--work_dir] of agent is [/disk1/tmp/mesos-agent] problems: 1). Stdout and stderr at sandbox of Some Completed Tasks should be display in webui, but they are disappeared, when task executed completed.( when executing stdout and stderr can be display.) 2). Stdout at sandbox of Some Completed Tasks should fully display in webui, but I can see the size of stdout about 2M, in webui just 2 lines displayed(just about 50 character). then I download the stdout, and got the full logger in my downloaded file(stdout). > Some stdout and stderr was disappeared. And some stdout can not fully display > in webui. > --- > > Key: MESOS-7151 > URL: https://issues.apache.org/jira/browse/MESOS-7151 > Project: Mesos > Issue Type: Bug > Components: agent >Affects Versions: 1.0.1 >Reporter: mark1982 > -- This message was sent by Atlassian JIRA (v6.3.15#6346)