Re: ATS 9.2.3 and cache bypass with parent

2024-02-06 Thread Veiko Kukk
where the wrong decision is made to send this request to parent? ATS 9.2.3 Thanks ahead, Veiko Kontakt John Rushford () kirjutas kuupäeval N, 21. detsember 2023 kell 18:22: > > That’s correct, go_direct=true > > > On Dec 21, 2023, at 9:03 AM, Veiko Kukk wrote: > > &g

Re: ATS 9.2.3 and cache bypass with parent

2023-12-21 Thread Veiko Kukk
> We have a test url that is located on upstream that we query regularly > to check if upstream storage is available and how fast it is to > respond. This test url is obviously excluded from caching in ats. > > In cache.config: > url_regex=.*/full/path/to/test/file.txt$ action=never-cache I had

ATS 9.2.3 and cache bypass with parent

2023-12-19 Thread Veiko Kukk
Hi Please help me to understand how should bypass work with ats 9. It worked well with ats 7, but apparently something has changed that I didn't see in changelogs before upgrading to 9.2. We have a test url that is located on upstream that we query regularly to check if upstream storage is

Re: ATS 9.2.3 and proxy.config.http.per_server.connection.min

2023-10-25 Thread Veiko Kukk
The link does not work. Kontakt Mo Chen () kirjutas kuupäeval T, 24. oktoober 2023 kell 18:18: > > I've created a Github issue to track this: > https://github.pie.apple.com/ats/trafficserver/issues/672

ATS 9.2.3 and proxy.config.http.per_server.connection.min

2023-10-23 Thread Veiko Kukk
Hi I'm upgrading from 7.1 to 9.2.3 and attempting to get a certain amount of connections kept open between ATS and upstream server to avoid connection creation overhead. In 7.1 this worked well CONFIG proxy.config.http.origin_min_keep_alive_connections INT 50 In 9.2.3 enabling CONFIG

Re: RAM cache on NVMe

2023-04-10 Thread Veiko Kukk
> you could do is to shard your content (small vs large) into two (or more) > domains, and then you can assign volumes based on those names. > > — Leif > > From hosting.config: > > > # Primary destination specifiers are > # domain= > # hostname= > &g

RAM cache on NVMe

2023-04-10 Thread Veiko Kukk
Hi We are currently using Nginx in front of ATS to store hot content on NVMe-s, but would like to drop it and only use ATS. ATS is using full SATA HDD-s to store its content (about 150TB per node) and ATS RAM cache is disabled entirely. >From reading ATS documentation, I only found how to enable

Re: Understanding _total_response_bytes statistics

2020-06-25 Thread Veiko Kukk
Hi again! I wonder if such statistics is considered normal? Should I open issue at Github instead of writing here? Veiko Kontakt Veiko Kukk () kirjutas kuupäeval K, 3. juuni 2020 kell 14:48: > > Hi, > > ATS 7.1.2, parent routing enabled. Everything goes through parent > exce

Understanding _total_response_bytes statistics

2020-06-03 Thread Veiko Kukk
Hi, ATS 7.1.2, parent routing enabled. Everything goes through parent except one test url request that has very small response size (20 bytes). To calculate ATS cache byte hit ratio, I'm using following metrics: "proxy.node.http.user_agent_total_response_bytes": "363046018479",

Re: CPU load at idle

2019-12-18 Thread Veiko Kukk
gt; https://docs.trafficserver.apache.org/en/latest/admin-guide/performance/index.en.html#polling-timeout > > On Fri, Dec 13, 2019 at 6:07 AM Veiko Kukk wrote: > > > > Hi > > > > ATS 7.1.2, Centos 7.7. > > I'm seeing 15-16% CPU load while there is no traffic at all. >

CPU load at idle

2019-12-13 Thread Veiko Kukk
Hi ATS 7.1.2, Centos 7.7. I'm seeing 15-16% CPU load while there is no traffic at all. proxy.process.cache.bytes_used 23934931615744 proxy.process.cache.bytes_total 23935065833472 Is that normal? Veiko

Re: [PROPOSAL] Replace LuaJIT configurations with YAML

2018-05-08 Thread Veiko Kukk
+1 from me too. It would be nice to have modern, easily parsable (for whatever automation) configuration file syntax. Veiko 2018-05-08 11:01 GMT+03:00 Bryan Call : > +1 > > -Bryan > > > > On May 7, 2018, at 12:47 PM, Leif Hedstrom wrote: > > > > Hi, > > >

Re: Parent initially marked as down

2018-03-29 Thread Veiko Kukk
Answering myself. URL remapping per parent does not seem to be possible. Nor is it poissible to define whether parent should be connected via SSL on in plain text. Veiko 2018-03-29 11:25 GMT+03:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > I think that suggestion you had

Re: Parent initially marked as down

2018-03-29 Thread Veiko Kukk
so reveal the same. > > > > On Wed, Mar 28, 2018 at 11:38 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > > Hi, > > > > No, only http. Connections to origin (via Internet) are made with https, > but > > internally we only do http (cheaper, simpler

Re: Parent initially marked as down

2018-03-28 Thread Veiko Kukk
2018-03-28 19:01 GMT+03:00 Jeremy Payne <jp557...@gmail.com>: > I think the issue is the child is sending a https request to the parent. > Does the parent support https on port 3128 ? > > On Wed, Mar 28, 2018 at 10:45 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > >

Parent initially marked as down

2018-03-28 Thread Veiko Kukk
Hi, I'm trying to get ATS 7.1.2 working with single parent and failover to origin. "clients" make request against ATS internally with plain http, with remap.config we map those requests to https. regex_map http://storage.(.*).cloud.ovh.net https://storage.$1.cloud.ovh.net @plugin=cachekey.so

Re: RPM or a .spec file?

2018-03-28 Thread Veiko Kukk
Hi, You can see if spec file found in my Fedora copr ATS builds suits you. https://copr-be.cloud.fedoraproject.org/results/vkukk/apache-traffic-server-7/epel-7-x86_64/00707444-trafficserver/ Veiko 2018-03-28 5:44 GMT+03:00 John Garvin : > Hi @users, > > I'm trying to

Re: ATS slow after ERR_CONNECT_FAIL

2018-03-06 Thread Veiko Kukk
.active_timeout_in: 900 Best regards, Veiko 2018-03-02 17:18 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > ATS 7.1.2, CentOS 7.4. > > We have regular requests via ATS in reverse mode to get response time > statistics and decide whether source is available. This request is exc

ATS slow after ERR_CONNECT_FAIL

2018-03-02 Thread Veiko Kukk
Hi, ATS 7.1.2, CentOS 7.4. We have regular requests via ATS in reverse mode to get response time statistics and decide whether source is available. This request is excluded from caching, so it always results in TCP_MISS/200 in normal conditions with response time fluctuation depending on the

Re: very long cache_open_read_end - timeout

2018-02-26 Thread Veiko Kukk
did you create? > > -Bryan > > > On Feb 23, 2018, at 3:14 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > > Hi, Mateusz > > I wonder if you might experience same issue as me. > https://github.com/apache/trafficserver/issues/3057 > > For me, solution, or

Re: very long cache_open_read_end - timeout

2018-02-23 Thread Veiko Kukk
Hi, Mateusz I wonder if you might experience same issue as me. https://github.com/apache/trafficserver/issues/3057 For me, solution, or I would rather call it workaround was to create volumes. Unfortunately, documentation regarding to storage performance issues/tuning is missing. Best regards,

Re: Understanding RAM cache size and limits

2018-02-18 Thread Veiko Kukk
447086 > proxy.process.cache.volume_3.ram_cache.misses 10697251 > proxy.process.cache.volume_4.ram_cache.total_bytes 77 > proxy.process.cache.volume_4.ram_cache.bytes_used 7997786880 > proxy.process.cache.volume_4.ram_cache.hits 30927240 > proxy.process.cache.volume_4.ra

Understanding RAM cache size and limits

2018-02-16 Thread Veiko Kukk
Hi, We have strange situation with ATS 7.1.2 where RAM cache has grown beyond set limits. # /opt/trafficserver/bin/traffic_ctl metric match ram proxy.process.cache.ram_cache.total_bytes 3112697856 proxy.process.cache.ram_cache.bytes_used 4493088640 proxy.process.cache.ram_cache.hits 1548

Re: Understanding ATS memory usage

2018-01-31 Thread Veiko Kukk
e latency > issues caused by other processes (ss -s). Can you run it during the time > you are seeing latency issues and post the results here? > > dstat -c --top-cpu -d --top-bio --top-latency -n > > -Bryan > > On Jan 26, 2018, at 5:48 AM, Veiko Kukk <veiko.k...@gmail.com&

Re: Understanding ATS memory usage

2018-01-26 Thread Veiko Kukk
. How to get rid of this regular slowness? Best regards, Veiko 2018-01-23 13:53 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > I should have noted before that, during that timeframe, there is no higher > disk activity than on average. No higher load, no disk late

Re: Understanding ATS memory usage

2018-01-23 Thread Veiko Kukk
org>: > > > On Jan 23, 2018, at 7:36 PM, Veiko Kukk <veiko.k...@gmail.com> wrote: > > Hi again, > > During that mysterious task that happens after ~ 50-51 minutes causes > requests/responses to slow down very much, even time out. > Requests that usually take few hundred

Re: Understanding ATS memory usage

2018-01-23 Thread Veiko Kukk
because a full duplicate of cache > directory can be very large. > > > On Tue, Dec 19, 2017 at 3:04 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > >> Hi, >> >> Really nobody knows how ATS uses memory? >> >> Veiko >> >> 2017-12-12 14:44 G

Re: Avoiding TCP_REFRESH_HIT

2018-01-09 Thread Veiko Kukk
rds, Veiko 2017-11-24 11:24 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > 1) I don't know. ATS is not in production yet, i just noticed that it > happened during testing. Since we are just moving from Squid to ATS, i'm > testing latest stable ATS, thats being 7.1.1

Re: accepting large number of inbound TCP connections

2017-12-29 Thread Veiko Kukk
Hi Mateusz When you run ab against your ATS to create high enough artificial load, do all requests succeed and how quickly? Using some tool like wireshark during ab testing to dump and analyze TCP traffic could then give you hint where exactly the failure happens. To exclude any network

Re: How to purge all cached negative responses

2017-12-21 Thread Veiko Kukk
test/admin- > guide/storage/index.en.html#inspecting-the-cache > > David > > On Thu, Dec 21, 2017 at 5:40 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > >> Hi, >> >> We had configuration mistake that enforced Cache-Contro: >> max-age=157784630 also to negat

How to purge all cached negative responses

2017-12-21 Thread Veiko Kukk
Hi, We had configuration mistake that enforced Cache-Contro: max-age=157784630 also to negative responses that then got cached. Now, after fixing config, we need to purge all those objects from cache. It's even good enough if I could get list of objects with certain HTTP status code, then I

Re: Exclude some URL-s from statistics and logging

2017-12-20 Thread Veiko Kukk
Hi, I wonder if stats over HTTP request are included in HIT/MISS statistics? Veiko 2017-12-06 14:05 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Thank you. Actually, log filter is nice but most important would be > statistics filter. > > Veiko > > 2017-12-06 3:0

Re: Documentation page is broken

2017-12-20 Thread Veiko Kukk
Hi again, Could somebody revert that change? It's really annoying to use page source to get to read the documentation. Veiko 2017-12-19 11:26 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > It worked yesteday, today i can't access parts of it. For

Documentation page is broken

2017-12-19 Thread Veiko Kukk
Hi, It worked yesteday, today i can't access parts of it. For example https://docs.trafficserver.apache.org/en/7.1.x/admin-guide/files/records.config.en.html#ram-cache Veiko

Re: Understanding ATS memory usage

2017-12-19 Thread Veiko Kukk
Hi, Really nobody knows how ATS uses memory? Veiko 2017-12-12 14:44 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > I'm confused about ATS memory configuration. I have a server with CentOS > 7, ATS 7.1.1, 64GB memory and ~ 10TB disk. > traffic_server proces

Re: Garbled log date stamp

2017-12-18 Thread Veiko Kukk
2943 and see > if this is your issue? > > — Leif > > > On Dec 11, 2017, at 7:08 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > > Hi > > ATS 7.1.1. > I'm trying to get human readable timestamps with ascii log formats. >

Re: Cache HIT/MISS header

2017-12-14 Thread Veiko Kukk
2017-12-13 21:09 GMT+02:00 James Peach : > > > I'd use the `xdebug` plugin, see apache.org/en/7.1.x/admin-guide/plugins/xdebug.en.html>. If you want the > `X-Cache` header in every response, then you can use `header_rewrite` to > inject the

Re: Cache HIT/MISS header

2017-12-13 Thread Veiko Kukk
If you also need MISS (our setup does not, we know amount of requests and amount of HIT's), you need to add another condition with set-header X-Cache "MISS" -- Veiko 2017-12-12 14:10 GMT+02:00 Veiko Kukk <veiko.k...@gmail.com>: > Hi, > > I recently had exact same task

Understanding ATS memory usage

2017-12-12 Thread Veiko Kukk
Hi, I'm confused about ATS memory configuration. I have a server with CentOS 7, ATS 7.1.1, 64GB memory and ~ 10TB disk. traffic_server process takes ~ 23GB memory with the configuration option (8GB) CONFIG proxy.config.cache.ram_cache.size INT 8589934592 ATS is using raw partition on HDD. * Why

Re: Cache HIT/MISS header

2017-12-12 Thread Veiko Kukk
Hi, I recently had exact same task: to include cache status in response headers. That's what I did: * proxy.config.http.insert_response_via_str 2 * Using header_rewrite plugin to create additional header with following config: cond %{SEND_RESPONSE_HDR_HOOK} [AND] cond %{HEADER:Via} /(\[cH|\[cR)/

Garbled log date stamp

2017-12-11 Thread Veiko Kukk
Hi ATS 7.1.1. I'm trying to get human readable timestamps with ascii log formats. -- Squid Log Format. squid = format { Format = '% % % %/% % % % % %/% %' } test_url_include = filter.accept('cquc CONTAIN /testurl') test_url_exclude = filter.reject('cquc CONTAIN /testurl') -- Log only test

Re: Exclude some URL-s from statistics and logging

2017-12-06 Thread Veiko Kukk
iles > https://docs.trafficserver.apache.org/en/latest/admin- > guide/files/logging.config.en.html > > Kit > > On Tue, Dec 5, 2017 at 4:35 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > > Hi everyone, > > > > ATS 7.1.1. I'd like to exclude some URL-s from cache statistics because

Exclude some URL-s from statistics and logging

2017-12-05 Thread Veiko Kukk
Hi everyone, ATS 7.1.1. I'd like to exclude some URL-s from cache statistics because they are for monitoring purposes only. Requests, that run relatively frequently, and ATS is configured to never cache those requests. I'd like to separate that from statistics and access logs to avoid distortion

Re: Avoiding TCP_REFRESH_HIT

2017-11-23 Thread Veiko Kukk
he.org/en/7.1.x/admin- > guide/files/records.config.en.html#proxy-config-http-cache- > when-to-revalidate > > Stephen > > On Nov 23, 2017, at 09:26, Veiko Kukk <veiko.k...@gmail.com> wrote: > > Now to think about it, i might have set dest_domain to wrong value.

Re: Avoiding TCP_REFRESH_HIT

2017-11-23 Thread Veiko Kukk
rewrite plugin and cond %{READ_RESPONSE_HDR_HOOK} Will see it that helps. Veiko 2017-11-23 18:38 GMT+02:00 Alan Carroll <solidwallofc...@oath.com>: > You might try fiddling with the 'cache.config' file and set a cache TTL of > 10 years or so. > > On Thu, Nov 23, 2017 at 10

Re: Avoiding TCP_REFRESH_HIT

2017-11-23 Thread Veiko Kukk
ting an If-Modified-Since request. > > https://hacks.mozilla.org/2017/01/using-immutable- > caching-to-speed-up-the-web/ > > David > > On Thu, Nov 23, 2017 at 10:07 AM, Veiko Kukk <veiko.k...@gmail.com> wrote: > >> In addition to my previous e-mail, headers t

Re: Avoiding TCP_REFRESH_HIT

2017-11-23 Thread Veiko Kukk
uest-Id: tx3a0af5473d5c41d38195c-005a16e30d < Date: Thu, 23 Nov 2017 15:02:37 GMT < X-IPLB-Instance: 12631 I assume, Expires header is here to blame and must be overriden in ATS config, but how? I don't have control over source, its Openstack Swift object storage. Veiko 2017-11-23 16:35 G

Avoiding TCP_REFRESH_HIT

2017-11-23 Thread Veiko Kukk
Hi, Could ATS in reverse proxy mode be configured such way that it would never try to revalidate from source? It is known that in our case, object never changes (and is never refetched from source) and it is desirable to avoid any source validation. Validation verification adds significant

Cache sharing between siblings

2017-11-15 Thread Veiko Kukk
Hi, I'm new to ATS, so far we've been using Squid, but due to it's instability are moving away. I'm interested in avoiding regional cache duplication in CDN system. Currently, we have several Squid servers working as siblings and only pulling from origin if none of them has the object in cache,