I found the cause of my problem !!
Apparantly curl uses BY DEFAULT the pragma : no-cache
option ...
This means indeed that the WC never caches the pages.
By using curl-loader (who does not use the no-cache
option) I noticed that indeed object was cached !
so I compared capture of both request and then I
noticed the pragma option ...
I spend 4 days on this default value and I want to
thank you for your effort !
--- Raemaekers Mark <markraem@yahoo.com> wrote:
> Thanks for your input, but unfortunately it is still
> not working.
>
> each time I launch : [curl-machine]#curl
> http://omp.wc.be/home.html I get in store.log :
> 1192090981.782 RELEASE 00 00000018
> CE042BF5E20CD75407DE72B1C8D0CA2C 200 1192093905
> 1192089432 -1 text/html 18/18 GET
> http://omp.wc.be/home.html
> 1192090981.782 SWAPOUT 00 00000019
> EFE6712C44DC67B734C8EC1E9436327C 200 1192093910
> 1192089432 -1 text/html 18/18 GET
> http://omp.wc.be/home.html
>
>
> ... and I see on the http server ther reqest coming
> in, so squid is still not caching. I do not
> understand
> why squid RELEASES the object first and then does
> SWAPOUT to disk.
>
> Here you see the result of curl -I
> http://omp.wc.be/home.html (also same behaviour on
> squid machine, meaning squid machine still contacts
> http server.
> [curl-machine]#curl -I http://omp.wc.be/home.html
> HTTP/1.0 200 OK
> Date: Thu, 11 Oct 2007 09:27:48 GMT
> Server: Apache/2.0.52 (Red Hat)
> Last-Modified: Thu, 11 Oct 2007 07:57:12 GMT
> ETag: "99c3-12-f3228600"
> Accept-Ranges: bytes
> Content-Length: 18
> Content-Type: text/html; charset=UTF-8
> X-Cache: MISS from omp.wc.be
> Via: 1.0 omp.wc.be:80 (squid/2.6.STABLE16)
> Connection: close
>
>
> tail -n 42 cache.log says :
> [root@rack4top logs]# tail -n 42 cache.log
> 2007/10/11 10:34:17| Starting Squid Cache version
> 2.6.STABLE16 for i686-pc-linux-gnu...
> 2007/10/11 10:34:17| Process ID 19543
> 2007/10/11 10:34:17| With 1024 file descriptors
> available
> 2007/10/11 10:34:17| Using epoll for the IO loop
> 2007/10/11 10:34:17| Performing DNS Tests...
> 2007/10/11 10:34:17| Successful DNS name lookup
> tests...
> 2007/10/11 10:34:17| DNS Socket created at 0.0.0.0,
> port 32776, FD 5
> 2007/10/11 10:34:17| Adding nameserver 127.0.0.1
> from
> squid.conf
> 2007/10/11 10:34:17| Unlinkd pipe opened on FD 9
> 2007/10/11 10:34:17| Swap maxSize 102400 KB,
> estimated
> 7876 objects
> 2007/10/11 10:34:17| Target number of buckets: 393
> 2007/10/11 10:34:17| Using 8192 Store buckets
> 2007/10/11 10:34:17| Max Mem size: 51200 KB
> 2007/10/11 10:34:17| Max Swap size: 102400 KB
> 2007/10/11 10:34:17| Rebuilding storage in
> /usr/local/squid/var/cache (CLEAN)
> 2007/10/11 10:34:17| Using Least Load store dir
> selection
> 2007/10/11 10:34:17| Current Directory is
> /usr/local/squid/var/logs
> 2007/10/11 10:34:17| Loaded Icons.
> 2007/10/11 10:34:17| Accepting accelerated HTTP
> connections at 0.0.0.0, port 80, FD 11.
> 2007/10/11 10:34:17| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2007/10/11 10:34:17| Accepting SNMP messages on port
> 3401, FD 13.
> 2007/10/11 10:34:17| WCCP Disabled.
> 2007/10/11 10:34:17| Configuring Parent
> 10.10.10.3/80/0
> 2007/10/11 10:34:17| Ready to serve requests.
> 2007/10/11 10:34:18| Done reading
> /usr/local/squid/var/cache swaplog (1 entries)
> 2007/10/11 10:34:18| Finished rebuilding storage
> from
> disk.
> 2007/10/11 10:34:18| 1 Entries scanned
> 2007/10/11 10:34:18| 0 Invalid entries.
> 2007/10/11 10:34:18| 0 With invalid flags.
> 2007/10/11 10:34:18| 1 Objects loaded.
> 2007/10/11 10:34:18| 0 Objects expired.
> 2007/10/11 10:34:18| 0 Objects cancelled.
> 2007/10/11 10:34:18| 0 Duplicate URLs
> purged.
> 2007/10/11 10:34:18| 0 Swapfile clashes
> avoided.
> 2007/10/11 10:34:18| Took 0.3 seconds ( 3.8
> objects/sec).
> 2007/10/11 10:34:18| Beginning Validation Procedure
> 2007/10/11 10:34:18| Completed Validation
> Procedure
> 2007/10/11 10:34:18| Validated 1 Entries
> 2007/10/11 10:34:18| store_swap_size = 4k
> 2007/10/11 10:34:18| storeLateRelease: released 0
> objects
>
>
> Very strange is that :
> 1. apparantly 1 Object is loaded (and I only ask for
> 1
> object) home.html and I am the only user on this
> test
> system.
> this indicates to me that the page is cached, but
> the
> squid allways fetches the object from the http sever
> ...
>
> Using following conf (using comments by Amos) ...
>
> #ACCELERATOR
> ###################
> http_port 80 accel defaultsite=omp.wc.be
> cache_peer 10.10.10.3 parent 80 0 no-query
> originserver name=webserver
> ######ACLS###############
> acl all src all
> cache_peer_domain webserver omp.wc.be
> acl mydomain dstdomain omp.wc.be
> http_access allow mydomain
> never_direct allow mydomain
> http_access deny all
> #CACHING RULES
> ###############
> acl QUERY urlpath_regex cgi-bin \?
> cache deny QUERY
> cache allow all
> refresh_pattern . 1440 20%
> 4320
> #MISCELLANIOUS
> ##################3
> visible_hostname omp.wc.be
> cache_effective_user squid
> #cache_effective_group squid
> dns_testnames omp.wc.be
> dns_nameservers 127.0.0.1
> cache_mem 50 MB
> [root@rack4top etc]#
>
> ... I allready tried the following :
> 1. removeing the cache_dir (squid -k shutdown ; rm
> -fr
> /usr/local/squid/var/cache/* ; squid -z) and
> recreating it; start squid
> 2. added the dns_nameservers 127.0.0.1 statement,
> bcc
> otherwise I get warning at startup that there are no
> DNS servers specified in /etc/resolv.conf
> /etc/resolv.conf only contains "files" an I am using
> /etc/hosts for dns lookup on the squid machine.
> cat /etc/hosts looks like this :
> 127.0.0.1 rack4top
> localhost.localdomain
> localhost
> 13.1.1.1 omp.wc.be (13.1.1.1 is
> interface where curl-machine talks to.)
> 3. commented the "refresh_pattern . 1440 20% 4320"
> statement and restarted squid. same behaviour (so I
> uncommneted it now)
>
> note : I compild squid with only --snmp-enabled
> option. furthermore I did NOT specify any other
> options with configure. Can this be an issue ?
> What am I overlooking ?
>
> Thanks in advance.
>
>
>
> --- Amos Jeffries <squid3@treenet.co.nz> wrote:
>
> > > Dear squid-cache.org,
> > >
> > > I have three RHEL4 servers :
> > >
> > > 1. configured with squid 2.6 Version
> 2.6.STABLE16
> > in
> > > accelerator mode
> > > 2. configured with (apache) httpd daemon
> > > 3. this machine has curl installed (to generate
> > http
> > > requests)
> > >
> > >
> > > Each time I do curl http://omp.wc.be/home.html,
> I
> > > notice that the WC ALLWAYS sends the reqeust to
> > the
> > > http server. It does NOT cache my home.html
> page.
> > > If I remove the "always_direct allow all"
>
=== message truncated ===
____________________________________________________________________________________
Take the Internet to Go: Yahoo!Go puts the Internet in your pocket: mail, news, photos & more.
http://mobile.yahoo.com/go?refer=1GNXIC
Received on Thu Oct 11 2007 - 04:58:59 MDT
This archive was generated by hypermail pre-2.1.9 : Thu Nov 01 2007 - 13:00:01 MDT