Re: Audio/Video Out of Sync

[tellyaddict]

Thanks Jim,

> Afraid the info I have is limited. But it makes clear that the BBC realise
> there *is* a problem with the hls segmentation and that Akamai are said to
> have a fix which is supposed to be being put in place. However I'd have
> thought that would happen today. Might be my misunderstanding, though.

As this problem appears to have got significantly worse today, I think it's 
possible that something was attempted but hasn't worked.

> A problem here is that I'm just one stage of a 'pass the parcel' when it
> comes to this. IIUC The fix isn't one the BBC themselves are doing, but
> someone else who is responding to them.

>From what you have said before, I get the feeling that the BBC have no control 
>over this problem because on that legacy system, all they (the BBC) do is send 
>the video files to Akamai. Akamai does the rest (segmenting, uploading etc) so 
>the problems start when Akamai start processing. So Akamai are the only ones 
>who can actually fix this problem. As we have seen from HVF and DASH, these 
>are segmented, packaged etc by the BBC and then uploaded to Akamai's servers, 
>and it seems that things processed by the BBC tend to work.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

RE: Audio/Video Out of Sync

[MacFH - C E Macfarlane]

Please see below ...

> -Original Message-
> From: get_iplayer [mailto:get_iplayer-boun...@lists.infradead.org] On
> Behalf Of Vangelis forthnet
> Sent: 17 August 2016 09:58
> To: get_iplayer@lists.infradead.org
> Subject: Re: Audio/Video Out of Sync
> 
> On Tue Aug 16 20:25:00 BST 2016, C E Macfarlane wrote:
> 
> > I was searching each night's log for the word 'error', but in fact the
> > missing segment messages come up as 'WARNING'.
> > It's not a big problem now that I've realised my mistake, but I think
> > that message ought to be changed to 'ERROR', because it means that the
> > resulting file will be corrupted.
> 
> Hello Charles, I hope all's well with you!

Yes, thanks, apart from my old laptop dying  -  it's a bummer, but I got
more life and use from it than I could ever have dared to expect for the
used price that I originally paid for it, so I can't really complain!  Hope
all's well with you as well.

> What you suggest has been already implemented in the develop branch
> (2.96-dev) of GiP, specifically with commit git-1564276:
> 
> https://github.com/get-iplayer/get_iplayer/commit/1564276

Excellent!  I'm glad to hear that.  Thanks.



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Jim web]

In article
,
   tellyaddict  wrote:
> Great so now the programmes are mostly made up of missing segments.
> Hopefully this shows they are trying to do something to the servers to
> fix this issue. Whatever they have done so far though appears to have
> had the opposite effect.

> @jim Do you have any info on what the problem is or what's being done
> about it?

Afraid the info I have is limited. But it makes clear that the BBC realise
there *is* a problem with the hls segmentation and that Akamai are said to
have a fix which is supposed to be being put in place. However I'd have
thought that would happen today. Might be my misunderstanding, though.

What I don't know is if they haven't actually carried this out yet, or if
the problems need flushing though in some way. I've reported that people
still have the problem. With luck I'll hear more tomorrow... or the fix
will be in place and work.

A problem here is that I'm just one stage of a 'pass the parcel' when it
comes to this. IIUC The fix isn't one the BBC themselves are doing, but
someone else who is responding to them.

Jim

-- 
Electronics  http://www.st-and.ac.uk/~www_pa/Scots_Guide/intro/electron.htm
Armstrong Audio  http://www.audiomisc.co.uk/Armstrong/armstrong.html
Audio Misc  http://www.audiomisc.co.uk/index.html


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Jim web]

In article <04EBC8DD8B6A48BCA3403FECE9D1FC59@RJCDESK>, RS
 wrote:


> If anything it seems to be getting much worse.  I tried the BBC1
> national News at One (b07myjll).  There were errors at 2, 3, 6, 25, 33,
> 39, 43, 44, 63, 71, 72, 73 ...

> The errors are getting closer together.

OK, I've asked someone about this. With luck I'll get a response tomorrow
morning.

Jim

-- 
Electronics  http://www.st-and.ac.uk/~www_pa/Scots_Guide/intro/electron.htm
Armstrong Audio  http://www.audiomisc.co.uk/Armstrong/armstrong.html
Audio Misc  http://www.audiomisc.co.uk/index.html


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[tellyaddict]

Great so now the programmes are mostly made up of missing segments. Hopefully 
this shows they are trying to do something to the servers to fix this issue. 
Whatever they have done so far though appears to have had the opposite effect.

@jim Do you have any info on what the problem is or what's being done about it?

___

> >> I have just tried BBC Business Live broadcast at 0830 to 0900 on BBC
> >> News (b07p4sqp) this morning again hlshd1.  It had errors at 9, 10, 12,
> >> 13, 21, 22, 35, 39, 44, 48 ...
> 
> >OK. Thanks. Whatever the reasons, the problems seem to be continuing at
> >present.
> 
> If anything it seems to be getting much worse.  I tried the BBC1 national 
> News at One (b07myjll).  There were errors at 2, 3, 6, 25, 33, 39, 43, 44, 
> 63, 71, 72, 73 ...
> 
> The errors are getting closer together.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[RS]

From: Jim web
Sent: Wednesday, August 17, 2016 16:05



I have just tried BBC Business Live broadcast at 0830 to 0900 on BBC
News (b07p4sqp) this morning again hlshd1.  It had errors at 9, 10, 12,
13, 21, 22, 35, 39, 44, 48 ...



OK. Thanks. Whatever the reasons, the problems seem to be continuing at
present.


If anything it seems to be getting much worse.  I tried the BBC1 national 
News at One (b07myjll).  There were errors at 2, 3, 6, 25, 33, 39, 43, 44, 
63, 71, 72, 73 ...


The errors are getting closer together.



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Jim web]

In article , RS
 wrote:
> >From: Jim web Sent: Wednesday, August 17, 2016 13:17

> >I don't know from the pid when b07pmyd6 was broadcast or put on-server.
> >Was that last night? If so, it looks like the fix hasn't been done yet,
> >or hasn't worked. I'll ask someone about it... but note that they in
> >turn have to refer though others.

> b07pmyd6 was Inside the Factory broadcast from 2000 to 2100 on BBC2 last
> night.  It is a new programme but could still have been made months ago.

I can't be certain at this point because my focus has tended to be on the
'Audio Factory' rather than the video. But by default I'd assume material
is injected into the iplayer system from the 'live feeds'. i.e. what is
being sent to TX.

> I have just tried BBC Business Live broadcast at 0830 to 0900 on BBC
> News (b07p4sqp) this morning again hlshd1.  It had errors at 9, 10, 12,
> 13, 21, 22, 35, 39, 44, 48 ...

OK. Thanks. Whatever the reasons, the problems seem to be continuing at
present.

Jim

-- 
Electronics  http://www.st-and.ac.uk/~www_pa/Scots_Guide/intro/electron.htm
Armstrong Audio  http://www.audiomisc.co.uk/Armstrong/armstrong.html
Audio Misc  http://www.audiomisc.co.uk/index.html


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Vangelis forthnet]

On Wed Aug 17 13:17:46 BST 2016, Jim web wrote: 


I don't know from the pid when b07pmyd6 was broadcast


... You can use the following template: 


http://www.bbc.co.uk/programmes//broadcasts

ergo

http://www.bbc.co.uk/programmes/b07pmyd6/broadcasts

=> BBC Two, 16 Aug 2016, 20:00 BST

[or use GiP itself: 

get_iplayer --pid=b07pmyd6 -i | FindStr lastbcast 
=>

lastbcast:  original: 2016-08-16T20:00:00+01:00

(on Linux Mint replace FindStr with grep)]

Cheers

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[RS]

From: Jim web
Sent: Wednesday, August 17, 2016 13:17



I don't know from the pid when b07pmyd6 was broadcast or put on-server. Was
that last night? If so, it looks like the fix hasn't been done yet, or
hasn't worked. I'll ask someone about it... but note that they in turn have
to refer though others.


b07pmyd6 was Inside the Factory broadcast from 2000 to 2100 on BBC2 last 
night.  It is a new programme but could still have been made months ago.


I have just tried BBC Business Live broadcast at 0830 to 0900 on BBC News 
(b07p4sqp) this morning again hlshd1.  It had errors at 9, 10, 12, 13, 21, 
22, 35, 39, 44, 48 ...





___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Jim web]

In article <1CF29C0BD25A48F5A6104EEDFD6C635F@RJCDESK>, RS
 wrote:
> >From: Jim web Sent: Wednesday, August 17, 2016 10:03

> >> Yes, that may be what's happening. I am using a relatively old LTS
> >> version of Mint. I don't want to upgrade distro juts for this, so
> >> I'll see if I can update either VLC or avconv.

> Is this from https://github.com/get-iplayer/get_iplayer/wiki/release295
> a repeat of the same information, or is it a new gloss on it?

> "There is one very important limitation: Downloads from Video Factory
> streams cannot be re-muxed to MP4 by avconv or ffmpeg <2.5. Only ffmpeg
> 2.5+ appears to work. 

I'll need to check what version of avconv/ffmpeg is installed on my
relevant machine. However it has reprocessed all the gip fetches since
install. And - until I started with the 50fps files obtained using hcfhd -
the results all play fine with VLC.

> As for the missing segments error, b0377vl5 still has lots of missing
> segments, 63, 64, 69, 73, 80 ... in HLShd1, but that's quite old. 
> b07pmyd6 in HLShd1 from last night has errors at 124, 129, 152, 184 ...

I don't know from the pid when b07pmyd6 was broadcast or put on-server. Was
that last night? If so, it looks like the fix hasn't been done yet, or
hasn't worked. I'll ask someone about it... but note that they in turn have
to refer though others. 

Jim

-- 
Electronics  http://www.st-and.ac.uk/~www_pa/Scots_Guide/intro/electron.htm
Armstrong Audio  http://www.audiomisc.co.uk/Armstrong/armstrong.html
Audio Misc  http://www.audiomisc.co.uk/index.html


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[RS]

From: Jim web
Sent: Wednesday, August 17, 2016 10:03



Yes, that may be what's happening. I am using a relatively old LTS
version of Mint. I don't want to upgrade distro juts for this, so I'll
see if I can update either VLC or avconv.


Is this from
https://github.com/get-iplayer/get_iplayer/wiki/release295
a repeat of the same information, or is it a new gloss on it?

"There is one very important limitation: Downloads from Video Factory 
streams cannot be re-muxed to MP4 by avconv or ffmpeg <2.5. Only ffmpeg 2.5+ 
appears to work. This is of particular note to users still on old LTS 
versions of Ubuntu (12.04, 14.04) and Mint (13, 17), and Mageia 5. If you 
are unable or unwilling to upgrade your system, you will need to acquire a 
modern version of ffmpeg if you wish create MP4 files from Video Factory 
streams (you can still download with --raw). There may be several 
alternatives available, but one possible solution is to use a static build 
of ffmpeg from:


http://johnvansickle.com/ffmpeg/;

As for the missing segments error, b0377vl5 still has lots of missing 
segments, 63, 64, 69, 73, 80 ... in HLShd1, but that's quite old.  b07pmyd6 
in HLShd1 from last night has errors at 124, 129, 152, 184 ...





___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Jim web]

In article <55b083fabc...@audiomisc.co.uk>, Jim web

wrote:

> Yes, that may be what's happening. I am using a relatively old LTS
> version of Mint. I don't want to upgrade distro juts for this, so I'll
> see if I can update either VLC or avconv.

Update on this:

This morning I refetched some files using hvfhd but this time using the
--raw option.

The resulting .ts files play fine with my copy of VLC!

So the situation seems to be here that the 'same' programme fetched using
hvfhd will play OK as the 'raw' ts but that allowing the usual conversion
to mp4 causes the audio track to be not be played by VLC.

This does solve my problem with playing the hvfhd results on a practical
level. But remains an oddity.

I spent the time this morning getting ts files this way. So I don't know if
the hls segmentation problem has been fixed. Anyone know?

Jim

-- 
Electronics  http://www.st-and.ac.uk/~www_pa/Scots_Guide/intro/electron.htm
Armstrong Audio  http://www.audiomisc.co.uk/Armstrong/armstrong.html
Audio Misc  http://www.audiomisc.co.uk/index.html


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Audio/Video Out of Sync

[Vangelis forthnet]

On Tue Aug 16 20:25:00 BST 2016, C E Macfarlane wrote: 

I was searching each night's log for the word 'error', 
but in fact the missing segment messages come up as 'WARNING'.  
It's not a big problem now that I've realised my mistake, 
but I think that message ought to be changed to 'ERROR', 
because it means that the resulting file will be corrupted.


Hello Charles, I hope all's well with you!

What you suggest has been already implemented 
in the develop branch (2.96-dev) of GiP, 
specifically with commit git-1564276: 


https://github.com/get-iplayer/get_iplayer/commit/1564276

Things in the develop branch are changing constantly currently, 
literally by-the-day! 
If anyone is to try it, FIRST READ ALL THE COMMIT TITLES in 


https://github.com/get-iplayer/get_iplayer/commits/develop/get_iplayer

(after "bump dev version")
and the commit summaries by clicking individual commits/snapshots.

If the hls tvmodes issues persist over time, 
then the next major GiP release will be out 
sooner rather than later!


Kind regards, 
Vangelis


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer