Re: Is there ready functionality for disabling caching of particular objects

2024-04-22 Thread Miles Libbey
(And there are close examples on that page: https://docs.trafficserver.apache.org/en/latest/admin-guide/plugins/header_rewrite.en.html#check-for-existence-of-a-header and

Re: Parent TLS

2021-11-04 Thread Miles Libbey
here's how we do it: For the child: remap.config: map https://inbound.example.com https://inbound.example.com parent.config dest_domain=inbound.example.com scheme=https parent=" my-upstream1.proxy.com:443:,my-upstream2.proxy.com:443" round_robin=consistent_hash go_direct=false For the

Re: New user docs.

2021-10-11 Thread Miles Libbey
Thanks Ken- - We moved on from Jira a few years back... so that's another doc oops. We're now using github issues.(https://github.com/apache/trafficserver/) - For Doc updates, just filing a PR is fine -- creating a bug report for a code change is the concept. Looking at Docs with fresh eyes is

Re: Query

2021-05-28 Thread Miles Libbey
Can you describe what you mean by categorization and ingest? If ingest means something like 'can ATS proxy a cache miss request over to a http server written by and/or hosted by another organization (nginx/node/IIS/Amazon S3, etc) and cache the result for future requests?' ... yes it does. miles

Re: [E] Installation error from GIT

2021-05-27 Thread Miles Libbey
FWIW, we use $ sudo service trafficserver start (which I believe is what Susan was referring to / uses) miles On Thu, May 27, 2021 at 6:43 AM Alan Carroll wrote: > > Be careful with the underscoring. > > "trrafficserver" is a script that takes the start|stop arguments. > "traffic_server" is the

Re: RAM disks for cache?

2021-04-07 Thread Miles Libbey
And to add a bit more context: - The RAM Cache is highly related to the Disk Cache and physical disks -- as you surmise, the disk cache would need to be at least as big as the RAM cache. - BUT, as Kit and Rob mention, RAM Disks are a neat cheat -- ATS thinks of them as a disk cache. If you are

Re: Dynamic Caching Issue

2021-03-27 Thread Miles Libbey
ine a >>>> beleaguered sysadmin who's been trying to get this to work for too many >>>> hours now then you've got a good image where I'm at. Here's what I've got: >>>> >>>> a) remap rule is as follows: >>>> [image: image.png] >>>

Re: Dynamic Caching Issue

2021-03-27 Thread Miles Libbey
When you say "redirecting" do you mean returning a 301/302/303/307/308 status code? Can you share a) the remap rule b) a curl with response headers through your ATS instance -- like curl -s -IXGET --resolve www.example.com:443:127.0.0.1 "https://www.example.com/; c) a curl with response headers

Re: Question about parent.config

2021-01-11 Thread Miles Libbey
Indeed -- we are on 8.1, and use the cachekey plugin to affect the url used to select parents (we ~exclusively use the consistent hash policy). I beleive the cachekey plugin allows for both specifically setting cachekey and/or setting the parent selection url. Presumably the consistent hash url

Re: Best way reload custom dynamic rules without ATS restart?

2020-10-11 Thread Miles Libbey
Hi- Unfortunately, these Global header rewrite rules (eg, that apply to *all* requests), are not reloadable. The way we get around this is to have very limited global rules. We have remap rules for each of our properties, and call header rewrite inside that for property specific rules. For

Re: Remap causing parent servers to not have a match

2020-05-07 Thread Miles Libbey
Unfortunately, 9 is neither released nor stable yet :/ Though we've not done it, I was thinking that you could use parent.config's "primary ring" to get the traffic to the peer, but, when down, sends it to itself through the secondary ring, and hitting its parent rule. I'm also not entirely sure

Re: Remap causing parent servers to not have a match

2020-05-07 Thread Miles Libbey
For our cache hierarchy we do: child: map inbound inbound parent.config: dest_domain=inbound scheme=http parent="..." go_direct=false parent: map inbound origin We do it this way because: - we can keep https throughout the hierarchy-- the children and parents can use the same certificates. We

Proposal for 9.x -- change X-Debug plugin's X-Cache order

2020-01-16 Thread Miles Libbey
Hi folks- In https://github.com/apache/trafficserver/pull/6328 we document the X-Debug plugin's behavior with multiple proxies. Unfortunately, it's done in the opposite order of the Via header (which is append, based on https://tools.ietf.org/html/rfc7230#section-5.7.1). This is confusing -- we

Re: ATS 8.0.5 parent.config and url_regex

2019-11-25 Thread Miles Libbey
I believe it uses the remap'ed url to match -- c23-ngxorg-01 for both cases which then matches your last dest_domain parent rule and goes to origin. FWIW, we follow the pattern: child map inboundURL inboundURL (with parent.config containing inboundURL) then the parent gets map inboundURL

Re: One-hit-wonder filtering

2019-07-26 Thread Miles Libbey
you! > > > Juncheng > > > On Jul 25, 2019, at 15:42, Miles Libbey wrote: > > +1. This is the purpose of that plugin! > > https://docs.trafficserver.apache.org/en/8.0.x/admin-guide/plugins/cache_promote.en.html > > On Thu, Jul 25, 2019 at 12:05 PM Jeremy P

Re: One-hit-wonder filtering

2019-07-25 Thread Miles Libbey
+1. This is the purpose of that plugin! https://docs.trafficserver.apache.org/en/8.0.x/admin-guide/plugins/cache_promote.en.html On Thu, Jul 25, 2019 at 12:05 PM Jeremy Payne wrote: > What about the 'cache promote' plugin ? > > > > On Thu, Jul 25, 2019 at 2:01 PM Sudheer Vinukonda < >

Re: TS on the private network without internet connection?

2019-04-24 Thread Miles Libbey
For an analysis project, I - wrote a tiny echo server -- all it needs to do in your case is return 404 and run it on your ATS machine - made a match-all rule that uses your echo server as the origin. For instance, if your echo server is running on port 8001: map / http://127.0.0.1:8001/ I'd think

Re: Need to remove header in ATS

2019-04-10 Thread Miles Libbey
Your original code looked right to me. So, I'm wondering if something else is preventing it from firing... permissions, installation, wrong path... something. Can you make it some other trivial task to make sure its loading? Like cond %{SEND_RESPONSE_HDR_HOOK} add-header Foo "bar" (and make sure

Re: cache.config: force caching for a particular url_regex

2019-03-29 Thread Miles Libbey
Could you show 2 requests in a row to the same file? The logs you posted were requests to different files (...241.txt, ...326.tt, ...327.txt). Since your origin seems like its doing the right thing, I'd stay away from the url_regex, and continue encouraging the correct behavior :) miles On Fri,

Re: trafficserver PUSH

2019-03-28 Thread Miles Libbey
I usually see 'Not Found on Accelerator' errors when the request to ATS does not match a remap rule (my experience is usually with remaps required). I believe the error is different when ip_allow rejects the request. Presumably you'd be able to fetch the object from origin with the same url

Re: check whether it will be a hit on trafficserver

2019-03-27 Thread Miles Libbey
I do: curl -IXGET -H "Cache-Control: only-if-cached" "http://myurlhere; The -IXGET makes it do a GET, but, drops the body. The Cache-Control: only-if-cached request header will have ATS respond with a 200 if the object is in cache, otherwise you get a 504 if not in cache. miles On Wed, Mar 27,

Re: Detecting Parent "Go_Direct" Condition from Header Rewrite or Lua HOOKs

2019-03-05 Thread Miles Libbey
If go_direct is doing the right thing, I think you could just have your remap switch to https, then have the parent.config scheme be https. eg remap.config: maps http://inbound.example.com https://origin.example.com parent.config: dest_domain=origin.example.com scheme=https parent="p1.x.com:443,

Re: collapse forwarding and if modified since

2019-02-24 Thread Miles Libbey
Am I reading the origin headers correctly -- that they are sending "no-cache", eg, please ask the origin every time if its ok to send the current object? Can you ask them to stop sending that and see if that changes behavior? (Also, no-cache doesn't take any arguments, so the ="set-cookie" part

Re: [EXTERNAL] Re: corrupt data with multiple concurrent client

2019-02-19 Thread Miles Libbey
Is the origin sending the data as Transfer-Encoding: Chunked? On Tue, Feb 19, 2019 at 12:53 PM Jeremy Payne wrote: > > ok.. i'm currently looking at some production 'document truncated' > errors.. which seem to only occur during these thundering herd > events.. > we're not using collapsed

Re: Need Header rewrite for mpd (dash)

2019-02-14 Thread Miles Libbey
You need a header rewrite rule that would do what? On Thu, Feb 14, 2019 at 10:43 AM Vasanth Mathivanan wrote: > > Hi , > > > > We had already header rewrite for m3u8 and ts . but now we are moving to mpd > so need for mpd and m4s header rewrite rule .i don’t know what was the exact > rule for

Re: [External] Re: how manage headers in cache

2019-02-12 Thread Miles Libbey
I don't quite get your configs versus your GET. eg, your remap has DNS:19009 but your GET is using the host dcpp-jaws-cache.ams.accenture.com:18009 ... which wouldn't match. Perhaps try, curl -IXGET http://DNS:19009/cxf/stubs/ats/serColor?name=color1+surname=Green -H"surname: red" -H "X-Debug:

Re: Unsubscribe

2019-02-11 Thread Miles Libbey
You need to send this to List-Unsubscribe: On Mon, Feb 11, 2019 at 5:01 AM Ananth Laxminarasimhan (alaxmina) wrote: > >

Re: [External] Re: how manage headers in cache

2019-02-11 Thread Miles Libbey
Yes, the cachekey plugin allows you to add request header values into the cache key -- so, your Green and Black objects would be stored distinctly. I'd probably go down that route, and use the Vary for compression alternates. On Mon, Feb 11, 2019 at 7:39 AM Divittorio, Vincenzo <

Re: get content from different origin server

2019-01-31 Thread Miles Libbey
FWIW, these are also reloadable. So, you can set them on the command line: traffic_ctl config set proxy.config.diags.debug.tags "http.*|dns.*|parent_select" traffic_ctl config set proxy.config.diags.debug.enabled 1 (don't forget to unset the debug logs. If you are getting any sort of volume, your

Re: ATS 7.1.5 not caching header Range: bytes=0-

2019-01-18 Thread Miles Libbey
We use the background fetch plugin for this case. https://docs.trafficserver.apache.org/en/8.0.x/admin-guide/plugins/background_fetch.en.html ATS can not fill the cache from a range request (but can fulfill range requests from objects in cache already). So, with the background fetch plugin, when

Re: Downtime when traffic_ctl config reload

2019-01-12 Thread Miles Libbey
"18.212.133.3:80,34.207.101.159:80" round_robin=consistent_hash > go_direct=false > > On parent nodes: > records.config > CONFIG proxy.config.http.parent_proxy_routing_enable INT 0 > CONFIG proxy.config.http.cache.http INT 1 >

Re: Downtime when traffic_ctl config reload

2019-01-11 Thread Miles Libbey
gt;> >>> >>> On Fri, Jan 11, 2019 at 11:33 AM Randall Meyer >>> wrote: >>>> >>>> >>>> Looking at your remap.config in that repo, I see that all the mappings are >>>> all commented out. Was that intentional? >>>>

Re: Downtime when traffic_ctl config reload

2019-01-11 Thread Miles Libbey
s are >>>> all commented out. Was that intentional? >>>> On Thursday, January 10, 2019, 8:28:53 PM PST, Hobin Yoon >>>> wrote: >>>> >>>> >>>> Yes, they are also ATS nodes and they worked fine when requests we

Re: Downtime when traffic_ctl config reload

2019-01-10 Thread Miles Libbey
We don't experience downtime when using traffic_ctl config reload (we use that ~daily). We don't use the balancer plugin. Instead, we use parent.config (https://docs.trafficserver.apache.org/en/8.0.x/admin-guide/files/parent.config.en.html) to achieve the same consistent hash. Your config would

Re: Questions on forwarding proxy in hierarchical mode

2018-12-16 Thread Miles Libbey
We effectively do that... we have our child remaps like: map https://alias.example.com https://alias.example.com with a parent.config line of dest_domain=alias.example.com scheme=http parent="parent1.example.com:80,..." round_robin=consistent_hash go_direct=false dest_domain=alias.example.com

Re: Looking for opinions on additions to ssl_server_name.yaml

2018-11-19 Thread Miles Libbey
On Mon, Nov 19, 2018 at 3:43 PM Susan Hinrichs wrote: > > Ok. I didn't know how to do lists in yaml. I think both of you are right for the yaml syntax fruits: [apples, oranges, strawberries] is equivalent yaml to fruits: - apples - oranges - strawberries > I think you will still want to

Re: trafficserver 8 - Logging Client request (domain)

2018-11-19 Thread Miles Libbey
omewhere randomly my squid.log not working. When > i remove cqtx its working. > > Op ma 19 nov. 2018 om 19:30 schreef Miles Libbey : >> >> Could you also post your formats definition? >> >> eg >> formats: >> - format: "id=firewall time=\"

Re: trafficserver 8 - Logging Client request (domain)

2018-11-19 Thread Miles Libbey
Could you also post your formats definition? eg formats: - format: "id=firewall time=\"% %\" fw=% pri=6 proto=% duration=% sent=% rcvd=% src=% dst=% dstname=% user=% op=% arg=\"%\" result=% ref=\"%<{Referer}cqh>\" agent=\"%<{user-agent}cqh>\" cache=%" name: welf On Sat, Nov 17, 2018 at 11:31 PM

Re: ATS cache miss if backend service DNS name rotates.

2018-11-12 Thread Miles Libbey
Could you try curl -x cache01:8080 -s -o /dev/null -X PUSH --data-binary @/path_to/data_file http://ceph-rgw/the/url/users/would/hit On Tue, Nov 13, 2018 at 2:18 AM Jin wrote: > > It worked with pristine host header enabled. However, I am facing an issue > when trying to tspush contents to

Re: ATS Problem on mpd file

2018-11-08 Thread Miles Libbey
Could you also say what version of ATS you are running? On Thu, Nov 8, 2018 at 11:00 AM Vasanth Mathivanan wrote: > > Hi, > > > > We have nginx with kalutra vod module its give the “mpd” content > dynamically vod content but I point the traffic sever as endpoint and orgin > is nginx . > > We

Re: ATS act as S3 endpoint?

2018-11-02 Thread Miles Libbey
I don't think I understand what's happening and what the problem is. if curl -vx ats-server.corp.com:8080 http://s3-store.corp.com:8080/bucket/object works, and your regex_remap below is on ats-server.corp.com, that seems to suggest that everything is working. As written, your regex_remap should

Re: ATS act as S3 endpoint?

2018-11-02 Thread Miles Libbey
On Fri, Nov 2, 2018 at 9:03 AM Jin wrote: > > I am thinking to build something like this: > > clients -> ats server -> s3 (ceph, aws...) > > By doing this, users do not need to change existing code to use ats as > proxy. Instead, ats becomes an S3 endpoint. > > I have a working ats setup that

Re: Communicate particular URL to bypass Origin Server

2018-10-25 Thread Miles Libbey
I'm not exactly clear on the scenario, but, there is a plugin that lets you try another origin if the first gives you an error https://docs.trafficserver.apache.org/en/8.0.x/admin-guide/plugins/escalate.en.html we have a config like map http://example.com http://origin.example.com \

Re: Query strings are can't stored in Cache storage ?

2018-10-12 Thread Miles Libbey
Accept-Ranges: bytes > > Content-Length: 48631 > > Content-Type: text/css > > Age: 1250 > > Connection: keep-alive > > Via: http/1.1 trafficserverurl.com (ApacheTrafficServer/6.2.3 [uScRs f p eN:t > cCHi p s ]) > > > > Could you please verify this output? &g

Re: Query strings are can't stored in Cache storage ?

2018-10-11 Thread Miles Libbey
Can you send the list the header output of the various curls? eg curl -IXGET "http://example.com/phpthatisntcaching.php; and curl -IXGET "http://example.com/cssthatiscaching.css; in particular, the Cache-Control headers. On Thu, Oct 11, 2018 at 5:56 AM Vasanth Mathivanan wrote: > > > > Hi, > >

Re: ATS cache miss if backend service DNS name rotates.

2018-10-10 Thread Miles Libbey
I wouldn't recommend excluding the FQDN (in case you get more domains later, and some portion of their paths have collisions). But, the prefix section https://docs.trafficserver.apache.org/en/7.1.x/admin-guide/plugins/cachekey.en.html#prefix-section does let you normalize them to your liking.

Re: Wiki access

2018-09-11 Thread Miles Libbey
Should be all set. miles On Mon, Sep 10, 2018 at 1:56 PM Olsen, Brian (Contractor) wrote: > > I would like to edit the wiki, in particular the following page: > > > >

Re: remap.config trailing slash problem

2018-07-19 Thread Miles Libbey
A few things strike me: - the proxy.config.http.redirection_enabled ==1 will have ATS chase the redirect. Eg, when the origin is returning the 301 for c to c/, ATS would go fetch c/ and return the results of c/ to the user. I think this would explain what your original post was showing? eg, when

Re: remap.config trailing slash problem

2018-07-18 Thread Miles Libbey
Hi- Could you show the results of a cURL both through your ATS and direct to the origin? eg through your ATS -- change 192.168.0.1 to its IP, and port 80 to its http port $ curl -IX GET -x 192.168.0.1:80 http://www.abc.com/c ... and to the origin: $ curl -IX GET http://www.abc.com/c miles On

Re: Write access to wiki

2018-05-07 Thread Miles Libbey
Done. miles On Mon, May 7, 2018 at 2:12 PM, Tim Bunce wrote: > Hi. > > I'd like to have write access to the wiki. My username is timbunce. > > Tim.

Re: [ANNOUNCE] Apache Traffic Server v7.1.2 is Released!

2018-01-18 Thread Miles Libbey
Also note that the setting proxy.config.http.normalize_ae_gzip got changed to proxy.config.http.normalize_ae in this release. So, if you were not using the proxy.config.http.normalize_ae_gzip default, you'll need to add proxy.config.http.normalize_ae with its equivalent. miles On Thu, Jan 18,

Re: Redundant origin server support

2017-12-23 Thread Miles Libbey
On Sat, Dec 23, 2017 at 8:16 AM, Alan Carroll wrote: > You can also use DNS round robin along with setting the server retries to a > non-zero value. Will that "save" the first request to the dead origin? (or would the error make its way back to the user?) > On Sat, Dec

Re: Redundant origin server support

2017-12-23 Thread Miles Libbey
Hi Sarp- I believe the way to do that purely in current ATS (eg, avoiding DNS) is to configure parent.config with the destination hostname that you need failover support. https://docs.trafficserver.apache.org/en/7.1.x/admin-guide/files/parent.config.en.html I've not used it (as we use smart DNS

Re: How to purge all cached negative responses

2017-12-21 Thread Miles Libbey
How about a header_rewrite like If status>399 Turn off cache. You might just be better off dropping the entire cache or changing the cache generation number for that remap ruleset. miles On Thursday, December 21, 2017, Sudheer Vinukonda < sudheervinuko...@yahoo.com> wrote: > Another option is

Re: Cache HIT/MISS header

2017-12-14 Thread Miles Libbey
;HIT") >>>> Response information received from origin server :no server >>>> connection needed >>>> Result of document write-to-cache: :no cache write >>>> performed >>>> Proxy operation result :unknown >&g

Re: unexpected high amount of Cold lookups

2017-12-13 Thread Miles Libbey
On Tue, Dec 12, 2017 at 2:46 AM, ezko wrote: > thanks for the suggestion miles. > > i checked the cache as you suggested. I think its OK. There are no > unexpected query strings , or other noticeable object variations. > proxy.process.cache.wrap_count seems low , and I

Re: Cache HIT/MISS header

2017-12-11 Thread Miles Libbey
Perhaps use the X-Debug header: https://docs.trafficserver.apache.org/en/7.1.x/admin-guide/plugins/xdebug.en.html and maybe a global header_rewrite rule to add the magic header to make the debug part appear? On Mon, Dec 11, 2017 at 8:57 AM, Benjamin Morel wrote: > Sorry

Re: unexpected high amount of Cold lookups

2017-12-10 Thread Miles Libbey
On Sun, Dec 10, 2017 at 8:56 AM, ezko wrote: > Hi, > i'm getting a pretty high number of > proxy.process.http.transaction_counts.miss_cold which I don't expect. > All my cached objects are set with an explicit Cache-Control max-age , so > when they expire , if a new

Re: how to make ATS to receive traffic on specific ports or certain traffic

2017-12-03 Thread Miles Libbey
Perhaps I'm misreading, but, that looks to me like ATS is answering your request, but can't reach the origin server. It looks like ATS is trying to get to your origin on 10.10.2.1:4, whereas you tested 10.10.2.2:80? Perhaps looking at your remap rule would be helpful. On Sun, Dec 3, 2017 at

Re: Configure ATS reverse proxy with live HLS origin returning Cache-Control: no-cache

2017-12-03 Thread Miles Libbey
TS to > work with the in-memory cache only ? No, the ram cache is too intertwined to the disk cache to do that. miles > thanks again. > > > > Miles Libbey wrote >> We tend to use the header_rewrite plugin for this in our remap rules. >> >> map http://inbound.example.com

Re: Configure ATS reverse proxy with live HLS origin returning Cache-Control: no-cache

2017-12-03 Thread Miles Libbey
We tend to use the header_rewrite plugin for this in our remap rules. map http://inbound.example.com \ http://origin.example.com \ @plugin=header_rewrite.so @pparam=hr.config With hr.config containing: cond %{READ_RESPONSE_HDR_HOOK} [AND] cond %{STATUS} >199 [AND] cond %{STATUS} <400

Re: [VOTE] Release Apache Traffic Server 7.1.1 (RC1)

2017-09-01 Thread Miles Libbey
On Fri, Sep 1, 2017 at 6:40 PM, Reindl Harald wrote: > > > Am 01.09.2017 um 22:43 schrieb Alan Carroll: >> >> Is that addressed by >>

Re: SSL for trafficserver

2017-06-30 Thread Miles Libbey
On Fri, Jun 30, 2017 at 5:19 AM, $ubbu wrote: > Hi, > > We are using apache traffic server for caching http sites for a quite > long time,recently we had to cache https sites . > > I took reference of >

Re: Help regarding parent.config

2017-05-19 Thread Miles Libbey
Perhaps a silly question, but do you have CONFIG proxy.config.http.parent_proxy_routing_enable INT 1set in records.config? miles On Friday, May 19, 2017 4:36 PM, gksalil wrote: I checked the logs - but no error messages found with respect to misconfigured

Re: Edit access to wiki page

2017-05-18 Thread Miles Libbey
Hi Persia-- You should have access now. miles On Thursday, May 18, 2017 7:49 AM, Persia Aziz wrote: I thought I had edit access to the wiki page. My username is "persia.aziz" and I am a committer.  Wiki page says to email here for edit access.  Syeda Persia

Re: Help regarding parent.config

2017-04-21 Thread Miles Libbey
Can you try comma separated values instead of semi-colons? dest_domain=. parent="127.0.0.1:4000, 127.0.0.1:4001" round_robin=true miles On Thu, Apr 20, 2017 at 10:02 PM, gksalil wrote: > Hello > >I have the following entry in parent.config. > > dest_domain=.

Re: Programmatically evicting cached resources that match an Authorization header

2016-11-23 Thread Miles Libbey
We use the AuthProxy plugin for a similar case. https://docs.trafficserver.apache.org/en/latest/admin-guide/plugins/authproxy.en.html The request comes in to ATS, it forwards on a HEAD request to an authorization service. If the authorization service returns 200 OK, then the object is released

Re: detailed transaction time logs

2016-11-21 Thread Miles Libbey
In ATS 6+ you use custom logging to log Milestone data about transactions ("{Milestone field name}ms" and {Milestone field name1-Milestone field name2}msdms). Milestones are here:

Re: question for mapping client to origin servers

2016-11-18 Thread Miles Libbey
ATS can log all the requests -- you have a fair amount of customization available: https://docs.trafficserver.apache.org/en/latest/admin-guide/logging/formatting.en.html On Fri, Nov 18, 2016 at 9:43 AM, Di Li wrote: > I think from the forward proxy perspective, I definitely want

Re: ATS Access control

2016-11-18 Thread Miles Libbey
You can also use the ip_allow configs inside a remap rule -- like: map http://inbound.example.com http://origin.example.com \ @src_ip=10.0.0.0-10.255.255.255 \ @action=allow or map http://inbound.example.com http://origin.example.com \ @action=deny @method=CONNECT

Re: Using ATS with the s3_auth plugin

2016-11-16 Thread Miles Libbey
I think its v3 auth only. In production our config looks like, @plugin=s3_auth.so @pparam=--config @pparam=/path/to/our/file (note the ".so" at the end of s3_auth) with file containing access_key=supersekret secret_key=moresekrets virtual_host miles On Wed, Nov 16, 2016 at 8:54

Re: Cache of interlinked URLs

2016-11-16 Thread Miles Libbey
How would the client get to the ATS for www.pgatour.com urls? If its a forward proxy, then the client would fetch all the resources through the proxy, and the cacheable pgatour.com content would get cached. On Wed, Nov 16, 2016 at 4:36 AM, $ubbu wrote: > Hi All, > > I'm

Re: Query strings are not forwarded

2016-10-28 Thread Miles Libbey
>> On Fri, Oct 28, 2016 at 4:34 PM, Sudheer Vinukonda < >> sudheervinuko...@yahoo.com> wrote: >> >>> Hmm...where's the pparam to strip query string? >>> >>> Please make sure to read through the documentation on cachekey. >>> Specifically,

Re: trafficserver and wordpress not work

2016-09-28 Thread Miles Libbey
>From your past emails, sounds like you have these remap rules: map http://10.10.17.104:8080/ula/ http://www.ula.ve:80/ map http://10.10.17.104:8080/templated http://127.0.0.1/html/ map http://10.10.17.104:8080/prueba/index.php http://10.10.17.103:80/prueba/index.php but the requests in the logs

Re: Does ATS support URLs longer than 8K?

2016-09-19 Thread Miles Libbey
nded with a 400, along with all the > other particulars in the log format. > > If I hit the server with a URL of around 10K in length, the server still > responds with a 400, but it doesn't go into the log at all. It's completely > absent. > > Adam > > On Thu, Sep 15, 2016 at 9

Re: Does ATS support URLs longer than 8K?

2016-09-15 Thread Miles Libbey
I know this isn't particularly helpful, but the other day I tested a Cookie Length of >65KB, and it worked on our system. I just tried a url like curl -x localhost:80 "http://example.com/?foo=`perl -e 'print "x" for 1..5'`" H "Cookie: x=`perl -e 'print "x" for 1..5'`" which was accepted.

Re: Why is proxy.config.cache.select_alternate undocumented?

2016-08-26 Thread Miles Libbey
I'd be careful of this. A primary use case for alternates is to vary on Accept-Encoding -- while modern browsers "all" do gzip, there are intermediaries that need uncompressed objects. So, serving the same compressed/uncompressed object to everyone may be problematic. Vary: User-Agent is bad,

Re: Mapping rule based on cookie

2016-07-13 Thread Miles Libbey
Think one way to do this would be: - use the header_rewrite plugin to check the cookie value and set the destination/origin Host. Not sure about the whole IP thing... perhaps make up a domain and set /etc/hosts to 100.100...? Or just set the Host to 100.100..? - use the cachekey plugin to put the

Re: Query on CacheURL plugin Multiple Domains, One Cache Object

2016-04-23 Thread Miles Libbey
- double capture group at the end? - Perhaps use the X-Debug plugin to see the cache-key?XDebug Plugin — Apache Traffic Server 7.0.0 documentation(curl -H "X-Debug: X-Cache-Key" -D- -o/dev/null "http://...; )- there is cacheurl plugin example for this case in the docCache URL Plugin — Apache

Re: can't cache head request

2016-03-30 Thread Miles Libbey
So, perhaps header_rewrite and cachekey... use header_rewrite to put the method in an internal header; then use cachekey to use that header in the cachekey?Header Rewrite Plugin — Apache Traffic Server 6.2.0 documentation |   | |   |   |   |   |   | | Header Rewrite Plugin — Apache Traffic

Re: How to set the Host header of the request to the origin server in hierachical caching

2016-03-08 Thread Miles Libbey
I think you'd setproxy.config.url_remap.pristine_host_hdr (https://docs.trafficserver.apache.org/en/latest/admin-guide/files/records.config.en.html#proxy-config-url-remap-pristine-host-hdr) to 1 (either for that remap rule using the conf_remap plugin

Re: Query on X-Cache in HTTP header

2016-02-12 Thread Miles Libbey
Perhaps use curl to request the origin server directly?  For instance: curl -D- -o/dev/null "http://gsmarena.com/foo/bar; On Friday, February 12, 2016 11:57 AM, Muhammad Faisal wrote: The origin was gsmarena.com not sure about the CDN. No im not using xdebug

Re: Low cache hit ratio and object caching

2016-01-29 Thread Miles Libbey
Can you send the headers that  http://netix.dl.sourceforge.net/project/filezilla/FileZilla_Client/3.11.0.2/FileZilla_3.11.0.2_win64-setup.exe   returns? (Wondering what the Cache-control: header says about the caching policy for that object). miles On Friday, January 29, 2016 2:02 AM,

Re: Low cache hit ratio and object caching

2016-01-29 Thread Miles Libbey
ective. On 1/29/2016 10:22 PM, Miles Libbey wrote: Can you send the headers that  http://netix.dl.sourceforge.net/project/filezilla/FileZilla_Client/3.11.0.2/FileZilla_3.11.0.2_win64-setup.exe   returns? (Wondering what the Cache-control: header says about the caching policy for that

Re: Logging Requests and Responses for specific 400 Errors

2016-01-28 Thread Miles Libbey
I think you can do this in the logs_xml.config with LogFilterslogs_xml.config — Apache Traffic Server 6.2.0 documentation You first describe the log you want (https://docs.trafficserver.apache.org/en/latest/admin-guide/monitoring/logging/log-formats.en.html#custom-logging-fields or the log

Re: Hot restart

2016-01-28 Thread Miles Libbey
Could you say what the properties of 'like nginx' you are looking for?  For instance, trafficserver has a way to reload configuration files without affecting existing connections... and a way to restart after draining existing

Re: Regex Remap plugin - follow redirect

2015-12-04 Thread Miles Libbey
I think this is indeed doable with the regex_remap plugin.  Something like map   http://origin/ \    http://thispartdoesntmatter \    @plugin=regex_remap.so @pparam=regex.config  where regex.config is your regex^/this.that.com/t.*/(.*)$ http://origin/$1 On Thursday, December 3, 2015 8:12

Re: thundering herd best practises

2015-07-09 Thread Miles Libbey
Thanks Sudheer-I read through the comments in TS-3549, but I don't grok what we are supposed to do in ATS 5.3x+ to get the almost Stale While Revalidate configured. Seems like this would be a great place to modify -- HTTP Proxy Caching — Apache Traffic Server 6.0.0 documentation (and probably

Re: Push Mode and Multicast in ATS

2015-04-22 Thread Miles Libbey
The HTTP PUSH can be used to fill the cache.  The traffic_primer script  apache/trafficserver |   | |   | |   |   |   |   |   | | apache/trafficservertrafficserver - Mirror of Apache Traffic Server | | | | View on github.com | Preview by Yahoo | | | |   | loops through a list (or takes a

Re: Implementing a cdn using apache traffic server

2015-04-12 Thread Miles Libbey
. On Sat, Apr 11, 2015 at 10:21 PM, Miles Libbey mlib...@apache.org wrote: One way to figure out if a particular url is being cached is to use the Cache-Control directive only-if-cached in the request. For instance: curl -H Cache-control: only-if-cached -D - -o /dev/null http://exacmple.com

Re: Implementing a cdn using apache traffic server

2015-04-11 Thread Miles Libbey
One way to figure out if a particular url is being cached is to use the Cache-Control directive only-if-cached in the request. For instance: curl -H Cache-control: only-if-cached -D - -o /dev/null http://exacmple.com/foo/bar; This will also show the headers of the object, which would be

Re: Error Log And Host Header(other headers)

2015-03-23 Thread Miles Libbey
Yes. in logs_xml.config, %cquuh would get you the original Host: header. Event Logging Formats — Apache Traffic Server 5.3.0 documentation |   | |   |   |   |   |   | | Event Logging Formats — Apache Traffic Server 5.3.0 documentationLog Field Slicing¶ It is sometimes desirable to slice a log

Re: 답장: Question about authproxy plugin

2014-08-25 Thread Miles Libbey
I would try: #remap.config map http://cache.foo.bar/ http://origin.foo.bar/   \   @plugin=authproxy.so @pparam=--auth-transform=redirect @pparam=--auth-host=auth.foo.bar @pparam=--auth-port=80 map http://auth.foo.bar/ http://auth.foo.bar/ miles From: Lau

Re: Apply to become an Apache Wiki editor contributor

2014-04-29 Thread Miles Libbey
Hi Qinghuan Min- I've given your wiki account permissions to edit the wiki. Let me know if you have issues. Thanks! miles libbey On Tue, Apr 29, 2014 at 8:43 PM, 闵庆欢(宗仪) zongyi@taobao.com wrote: Hi, Now I am a user of apache trafficserver wiki, and I expect to be able to contribute some

Settings you always change

2013-10-17 Thread Miles Libbey
Hi folks- Want to get a sense of configuration settings that folks typically change, in hopes of changing some of ATS' default settings. For instance, I'm betting that most people change storage.config to have a cache bigger than 256MB. What other settings do you usually change? Thanks! miles

Traffic Server wiki permissions change

2013-10-03 Thread Miles Libbey
Hi folks- The other day Apache changed all of its' project's wiki permissions to reduce the amount of spam it was receiving. Now, to edit the wiki, your account needs specific permission. As of right now, only the following usernames(ish -- removed some email addy info ) have access to edit the

Re: update cache in background

2011-09-26 Thread Miles Libbey
They (http://tools.ietf.org/html/rfc5861) can be supported by writing a plugin -- I know Yahoo has one, but it needs a bit of work to get it out into the project. I think Bryan was going to spend some time on doing that. miles On Sep 26, 2011, at 12:10 PM, Mav Peri wrote: Thanks for the reply

Re: Chinese Version of Traffic Server Administrator's Guide is now available

2010-11-05 Thread Miles Libbey
Wow -- that's great! What format is the version in (pdf, some word processor, etc)? Do you have thoughts on how the documentation site should include your work? thanks, miles On Nov 3, 2010, at 9:57 PM, 千石 wrote: Guys and Gals: We are the first team in China who are dealing with

Re: setting url specific caching time

2010-08-30 Thread Miles Libbey
FWIW, the Via: header is now documented here: http://trafficserver.apache.org/docs/v2/admin/trouble.htm#interpret_via_header miles On Aug 9, 2010, at 12:21 PM, Leif Hedstrom wrote: On 08/08/2010 11:44 PM, Steve Jiang wrote: Pranav Modi wrote, on 8/8/10 10:32 PM: Age14400 TS thinks the