[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Parker Reed]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #17 from Parker Reed  ---
Created attachment 122496
  --> https://bugs.kde.org/attachment.cgi?id=122496=edit
Malformed kioslaverc

Figured out the culprit. My ~/.config/kioslaverc had some old malformed proxy
entries. Nuking the rc and running without properly opens URL based on mimetype
instantly.

Uploading the bad kioslaverc as an example

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Parker Reed]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #16 from Parker Reed  ---
Created attachment 122495
  --> https://bugs.kde.org/attachment.cgi?id=122495=edit
kde-open5 strace with timestamps

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Parker Reed]

https://bugs.kde.org/show_bug.cgi?id=364662

Parker Reed  changed:

   What|Removed |Added

 CC||parker.l.r...@gmail.com

--- Comment #15 from Parker Reed  ---
Running into this on plasma-framework 5.61

With the default applications URL handler set to "in an application based on
the contents of the URL" it takes 1:16 to open http://google.com with kde-open5

Attached log

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka]

https://bugs.kde.org/show_bug.cgi?id=364662

Konrad Materka  changed:

   What|Removed |Added

 Resolution|WAITINGFORINFO  |NOT A BUG

--- Comment #14 from Konrad Materka  ---
Chris, I don't know, it's up to you. I can't reproduce it right now (no proxy)
and the most annoying problem related to this feature is described in separate
Bug 354246.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Christoph Feck]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #13 from Christoph Feck  ---
Konrad, do we need to re-open this ticket? The current bug status looks a bit
ambiguous.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka]

https://bugs.kde.org/show_bug.cgi?id=364662

Konrad Materka  changed:

   What|Removed |Added

 Resolution|FIXED   |WAITINGFORINFO

--- Comment #12 from Konrad Materka  ---
Most probably it is not resolved, simply it is now harder to reproduce because
internet connections are faster.

After rethinking it I don't know if it is a bug or a feature, even if I don't
like how it behaves :)

The main issue is that by default for all URLs KDE tries to get content type
first, then open URL. It is a default setting in:
System Settings -> Default applications -> Web browser:
"open in application based on the contents of the URL"

It is a neat feature, but it causes lags when:
* network connection is slow
* KDE has wrong proxy settings
* URL should be opened in the browse, because browser uses... (you name it: 
authentication - like Mutual SSL, proxy, cookies, specific user agent, etc)

Another problem is described in Bug 354246 where KDE opens redirected URL.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Nate Graham]

https://bugs.kde.org/show_bug.cgi?id=364662

Nate Graham  changed:

   What|Removed |Added

 Status|UNCONFIRMED |RESOLVED
 Resolution|--- |FIXED
 CC||n...@kde.org

--- Comment #11 from Nate Graham  ---
Works for me in KDE Frameworks 5.49. I've seen a few of these "slow URL
loading" bugs, but they all seems to have been fixed since they were filed. Let
me know if anyone can still reproduce with a recent version of KDE Frameworks.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Simon Andric]

https://bugs.kde.org/show_bug.cgi?id=364662

Simon Andric  changed:

   What|Removed |Added

 CC||simonandr...@gmail.com

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #10 from Konrad Materka  ---
Issue with redirect is in fact a regression introduced... more than 7 years
ago. Please check lines 1393 and 1478:
https://github.com/KDE/kdelibs/blame/fee65b598f0d68ae7b4fbc3f76cb0c083f6d30ef/kio/kio/krun.cpp

Now it is hosted in different repository but history is lost:
https://github.com/KDE/kio/blame/master/src/widgets/krun.cpp

Sorry for cross-posting. I commented the same in bug 354246, but it is closed
as a duplicate.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #9 from Konrad Materka  ---
I looked at the code, it might be tricky to fix it.

First thing why KDE is not opening URL in the browser but tries to connect to
URL internally. This is a feature, not a bug :) When you pass URL pointing to,
for example, zip archive it will open directly in Ark, not in the browser. This
is pretty neat if you ask me :)

The problem is in two cases:
* connection refuse/timeout/etc when KDE is configured with wrong proxy (or any
other cause). Usually when browser is configured differently than KDE (for
example proxy). It is hard to say if this is a bug or not.
* URL content is behind some kind of authorization, for example link to
internal Jira issue. KDE internally follows redirection to login page, then
recognizes content as HTML and opens new (redirected) URL in the browser. This
is exactly what was described in bug 354246.

I think that bug 354246 was wrongly marked as duplicate, it is a different
case.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Geert Janssens]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #8 from Geert Janssens  ---
Oops, that was a typo in comment 6 indeed. I meant to refer to the bug that was
actually set as a duplicate of this one. Sorry about the confusion.

The core remains though, I'd very much like to see this one fixed, although the
helpful workaround does reduce the urgency.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #7 from Konrad Materka  ---
The comment 6 above is wrong, probably added by accident in this bug report.
Bug 354216 is *not* a duplicate of this one - it looks as a completely
different story.
This bug is a duplicate of (or in fact is duplicated by) bug 354246. I
described it in comment 2 and comment 3, also description in bug 354216 is very
good.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Geert Janssens]

https://bugs.kde.org/show_bug.cgi?id=364662

Geert Janssens  changed:

   What|Removed |Added

 CC||i...@kobaltwit.be

--- Comment #6 from Geert Janssens  ---
While bug 354216 was marked as a duplicate of this one, it describes the root
cause much better: kde-open5 is not coping well with several http(s) variants.
As this bug is kept open and the bug 354216 marked as a duplicate, it may be
useful to change the title of this bug to reflect this cause.

I'm hitting this same issue mostly when clicking on links in mail messages in
KMail, presently with kmail 17.04.1 on Fedora 26. Before stumbling on this bug
I thought kde-open5 was mangling certain urls (like improperly escaping special
characters such as '#', '&', '?' and similar), but now I believe it's the
improper redirection handling that's causing most of it. So I'd be very happy
to see some progress on this bug.

Unfortunately I don't know the kde codebase at all so I'm not in a position to
answer Andrea's questions in comment 5. Can someone else chime in ? Thanks.

And lastly, the workaround suggested in comment 3 works for me for now.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Andrea Scarpino]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #5 from Andrea Scarpino  ---
I'm trying to fix this, but I need some help.

I found out that since redirectionHandlingEnabled is enabled by default, this
statement in transferjob.cpp at
https://cgit.kde.org/kio.git/tree/src/core/transferjob.cpp#n114 handles the
redirection.
I tried to disable the redirection in krun.cpp at
https://cgit.kde.org/kio.git/tree/src/widgets/krun.cpp#n1147, but I broke it
because kde-open5 "never ends", but instead waits for something. I suspect
foundMimeType() should be call (which is triggered when mimetype signal is
emitted at https://cgit.kde.org/kio.git/tree/src/widgets/krun.cpp#n1151, but
with redirectionHandlingEnabled=false this switch case at
https://cgit.kde.org/kio.git/tree/src/core/slaveinterface.cpp#n250 is never
triggered and then mimetype signal isn't emit.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Andrea Scarpino]

https://bugs.kde.org/show_bug.cgi?id=364662

Andrea Scarpino  changed:

   What|Removed |Added

 CC||scarp...@kde.org

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Andrea Scarpino]

https://bugs.kde.org/show_bug.cgi?id=364662

Andrea Scarpino  changed:

   What|Removed |Added

 CC||fgou...@codeweavers.com

--- Comment #4 from Andrea Scarpino  ---
*** Bug 354246 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #3 from Konrad Materka  ---
In other words - xdg-open runs kde-open5 which uses KRun mechanism from KIO.
When no external browser is set in System Setting then it causes issues.
Workaround (not fix!) is to setup "firefox" as default browser in System
Setting -> Application -> Default application -> Web browser. You can also put
there x-www-browser if Firefox is your system default.

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Konrad Materka via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=364662

Konrad Materka  changed:

   What|Removed |Added

 CC||kmate...@wp.pl

--- Comment #2 from Konrad Materka  ---
I think the root cause is that KDE is trying to open url internally, then
passes it to the browser. This approach has several flaws, including big delay,
redirection issues, proxy etc. Passed url should go directly to browser.

The root cause was reported in:
https://bugs.kde.org/show_bug.cgi?id=354246

-- 
You are receiving this mail because:
You are watching all bug changes.

[frameworks-kio] [Bug 364662] Opening URLs is very slow or aborted completely

[Bzzz via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=364662

--- Comment #1 from Bzzz  ---
running the xdg command with strace results in:

trace xdg-open
'https://forum.kde.org/viewtopic.php?f=289=124392=327270#p327270'
execve("/usr/bin/xdg-open", ["xdg-open",
"https://forum.kde.org/viewtopic.;...], [/* 76 vars */]) = 0
brk(NULL)   = 0x560b4479f000
access("/etc/ld.so.nohwcap", F_OK)  = -1 ENOENT (No such file or directory)
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f9674e55000
access("/etc/ld.so.preload", R_OK)  = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=280150, ...}) = 0
mmap(NULL, 280150, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f9674e1
close(3)= 0
access("/etc/ld.so.nohwcap", F_OK)  = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\t\2\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=1864888, ...}) = 0
mmap(NULL, 3967488, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) =
0x7f9674869000
mprotect(0x7f9674a29000, 2093056, PROT_NONE) = 0
mmap(0x7f9674c28000, 24576, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1bf000) = 0x7f9674c28000
mmap(0x7f9674c2e000, 14848, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f9674c2e000
close(3)= 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f9674e0f000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f9674e0e000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7f9674e0d000
arch_prctl(ARCH_SET_FS, 0x7f9674e0e700) = 0
mprotect(0x7f9674c28000, 16384, PROT_READ) = 0
mprotect(0x560b429d2000, 8192, PROT_READ) = 0
mprotect(0x7f9674e57000, 4096, PROT_READ) = 0
munmap(0x7f9674e1, 280150)  = 0
getuid()= 1000
getgid()= 1000
getpid()= 6029
rt_sigaction(SIGCHLD, {0x560b427c6540, ~[RTMIN RT_1], SA_RESTORER,
0x7f967489e4a0}, NULL, 8) = 0
geteuid()   = 1000
brk(NULL)   = 0x560b4479f000
brk(0x560b447c) = 0x560b447c
getppid()   = 6027
stat("/home/bzzz/Downloads", {st_mode=S_IFDIR|0700, st_size=69632, ...}) = 0
stat(".", {st_mode=S_IFDIR|0700, st_size=69632, ...}) = 0
open("/usr/bin/xdg-open", O_RDONLY) = 3
fcntl(3, F_DUPFD, 10)   = 10
close(3)= 0
fcntl(10, F_SETFD, FD_CLOEXEC)  = 0
geteuid()   = 1000
getegid()   = 1000
rt_sigaction(SIGINT, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGINT, {0x560b427c6540, ~[RTMIN RT_1], SA_RESTORER,
0x7f967489e4a0}, NULL, 8) = 0
rt_sigaction(SIGQUIT, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGQUIT, {SIG_DFL, ~[RTMIN RT_1], SA_RESTORER, 0x7f967489e4a0},
NULL, 8) = 0
rt_sigaction(SIGTERM, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGTERM, {SIG_DFL, ~[RTMIN RT_1], SA_RESTORER, 0x7f967489e4a0},
NULL, 8) = 0
read(10, "#!/bin/sh\n#-"..., 8192) = 8192
read(10, " echo \"Use --novendor to overrid"..., 8192) = 8192
read(10, "desktop\nif [ -r \"$dir/$defau"..., 8192) = 6362
stat("/usr/local/sbin/kde-open5", 0x7ffd2093e500) = -1 ENOENT (No such file or
directory)
stat("/usr/local/bin/kde-open5", 0x7ffd2093e500) = -1 ENOENT (No such file or
directory)
stat("/usr/sbin/kde-open5", 0x7ffd2093e500) = -1 ENOENT (No such file or
directory)
stat("/usr/bin/kde-open5", {st_mode=S_IFREG|0755, st_size=31696, ...}) = 0
clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD,
child_tidptr=0x7f9674e0e9d0) = 6030
wait4(-1, 

[waits...]

[{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 6030
--- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=6030, si_uid=1000,
si_status=0, si_utime=8, si_stime=2} ---
rt_sigreturn({mask=[]}) = 6030
exit_group(0)   = ?
+++ exited with 0 +++

after that, I ran the same command again one folder higher (~/), and it
instantly opened the web page:

strace xdg-open
'https://forum.kde.org/viewtopic.php?f=289=124392=327270#p327270'
execve("/usr/bin/xdg-open", ["xdg-open",
"https://forum.kde.org/viewtopic.;...], [/* 76 vars */]) = 0
brk(NULL)   = 0x561eef8a1000
access("/etc/ld.so.nohwcap", F_OK)  = -1 ENOENT (No such file or directory)
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x7efe17cc7000
access("/etc/ld.so.preload", R_OK)  = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=280150, ...}) = 0
mmap(NULL,