Unable to access any HTTPS websites due to access restrictions policies

General Information about how to make best use of this forum
India shivamjr
Posts: 3
Joined: Wed Sep 01, 2021 11:43 am

Unable to access any HTTPS websites due to access restrictions policies

Post by shivamjr » Thu Sep 09, 2021 12:02 pm

Brief:-
I made a policy for three User Groups i.e Network_Group, VIP_Group, and Finance_Group
Now, Network Group should be able to access the safesquid interface so that he can change policies by creating, updating, and deleting it, and can also access every websites.
VIP_GROUP & Finance_Group :- should not be able to access safesquid interface, and cannot access any malware, phishing or pornography sites

So, Below you can see I have created Three Access restriction policies for Network Group, VIP Group and Finance Group.

Problem:-
So after successfully creating policies, Network user was able to access safesquid interface but was not able to access any HTTPS website,
VIP_GROUP & Finance_Group were not able to access safesquid interface as mentioned in policies, but they were also not able to access any HTTPS websites.

Conclusion
:-
So after lot of debugging I came to a conclusion that, You have to add 1 more blank policy at the last, after you have created all your policies.
this solved my problem and users were able to access HTTP as well as HTTPS websites.

Below you can find all the Logs of safesquid, before adding the extra policy and after adding the extra policy
unable to access any website.png
unable to access any website.png (234.42 KiB) Viewed 1154 times
False.png
False.png (242.58 KiB) Viewed 1154 times
------------------------------LOGS BELOW (before adding an extra policy at the last)-------------------------------
********* HTTPS request log here: - ***********

Code: Select all

2021 09 09 16:34:24.580 [156] network: accepted: client (10.10.4.6:15714) 10.10.4.6:8080 [fd:45]
2021 09 09 16:34:24.580 [156] header: debug: [request:1] header_get(client) client (10.10.4.6:15714) 10.10.4.6:8080:
CONNECT www.google.com:443 HTTP/1.1
Host: www.google.com:443
Proxy-Authorization: Basic bmlyYWo6TmlyYWpAMTIz
User-Agent: curl/7.58.0
Proxy-Connection: Keep-Alive

2021 09 09 16:34:24.580 [156] category: debug: private categorization: categories :[none]
2021 09 09 16:34:24.580 [156] category: debug: categorize_using_global_db:651 ((not found))
2021 09 09 16:34:24.580 [156] category: module: debug: ssqore: hot cache[29]:hit url: www.google.com/
2021 09 09 16:34:24.580 [156] category: debug: ssqore:rate_request www.google.com/ [categories:1]
2021 09 09 16:34:24.580 [156] category: debug: ssqore:rate_request www.google.com/ [Search Engines & Portals]
2021 09 09 16:34:24.580 [156] category: module: debug: ssqore:ssqore_req_profile [latency: 0.0280ms] www.google.com/
2021 09 09 16:34:24.580 [156] ldap: debug: set_dn:1034 ip:[10.10.4.6] user:[NIRAJ@SAFESQUID.TEST] DN:[CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test] Groups:[OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST]
2021 09 09 16:34:24.581 [156] network: debug: DNS[IPv4]: cache[hit] www.google.com -> 172.217.160.164
2021 09 09 16:34:24.581 [156] ssl: debug: SSLcertSection::check:2129 deep scan TRUE
2021 09 09 16:34:24.587 [156] ssl: debug: ClientEncrypt:2768 10.10.4.6:ready
2021 09 09 16:34:24.587 [156] ssl: debug: CTXcacheIN::set_default_ctx: cache:hit size[2] ref[0]
2021 09 09 16:34:24.588 [156] ssl: debug: CertPool::GetKey:5650 size[7] cache:hit domain:.google.com ret[1]
2021 09 09 16:34:24.591 [156] ssl: debug: session_ticket_cb_in:380 renew 10.10.4.6:15714 [www.google.com]
2021 09 09 16:34:24.591 [156] ssl: debug: session_ticket_cb_in:380 renew 10.10.4.6:15714 [www.google.com]
2021 09 09 16:34:24.591 [156] ssl: debug: Socket::EncryptC:1501 client (10.10.4.6:15714) 10.10.4.6:8080 [retry:1] [cache mode:770] [reused:no] www.google.com (TLS_AES_256_GCM_SHA384)
2021 09 09 16:34:24.591 [156] network: ClientPool::Add:145 idle client (10.10.4.6:15714) 10.10.4.6:8080
2021 09 09 16:34:24.591 [156] header: debug: [request:2] header_get(client) client (10.10.4.6:15714) 10.10.4.6:8080:
HEAD / HTTP/1.1
Host: www.google.com
User-Agent: curl/7.58.0
Accept: */*

2021 09 09 16:34:24.591 [156] category: debug: private categorization: categories :[none]
2021 09 09 16:34:24.591 [156] category: debug: categorize_using_global_db:651 ((not found))
2021 09 09 16:34:24.591 [156] category: module: debug: ssqore: hot cache[29]:hit url: www.google.com/
2021 09 09 16:34:24.591 [156] category: debug: ssqore:rate_request www.google.com/ [categories:1]
2021 09 09 16:34:24.591 [156] category: debug: ssqore:rate_request www.google.com/ [Search Engines & Portals]
2021 09 09 16:34:24.591 [156] category: module: debug: ssqore:ssqore_req_profile [latency: 0.0110ms] www.google.com/
2021 09 09 16:34:24.591 [156] security: warn: [IP:10.10.4.6] access policy has refused connection on port 8080
2021 09 09 16:34:24.591 [156] security: warn: [IP:10.10.4.6] Access Denied by Access Restrictions
2021 09 09 16:34:24.591 [156] template: debug: TemplateSection::get:173 name[noaccess] code[-1]
2021 09 09 16:34:24.591 [156] template: debug: TemplateSection::get:173 name[interface.css] code[0]
2021 09 09 16:34:24.592 [156] header: debug: header_send: client (10.10.4.6:15714) 10.10.4.6:8080
HTTP/1.1 200 OK
Date: Thu, 09 Sep 2021 11:04:24 GMT
Content-Length: 21629
Connection: close
X-Powered-By: safesquid-2021.0904.1613.3-swg-concept
X-SafeSquid-Client-ID: 156.2
X-SafeSquid-Categories: Search Engines & Portals
X-SafeSquid-Request-Types: Curl,Google
X-SafeSquid-Application-Signatures: Curl,Google
X-URL-Cat: Search Engines & Portals
X-Registered-Domain: google.com

2021 09 09 16:34:24.592 [156] network: ClientPool::Add:145 close client (10.10.4.6:15714) 10.10.4.6:8080
2021 09 09 16:34:24.592 [ClientPool Terminator] network: debug: client_close:578 idle connections: 1
2021 09 09 16:34:24.592 [156] network: Socket::client disconnecting: client (10.10.4.6:15714) 10.10.4.6:8080 [xacts:2] [read:248.000B] [write:521.000B]
2021 09 09 16:34:24.592 [156] network: debug: ~Socket:617 s_shut client (10.10.4.6:15714) 10.10.4.6:8080 [CLIENT|SSL|S_SSL_SHUT]
2021 09 09 16:34:24.592 [156] network: debug: ~Socket:656 s_shut client (10.10.4.6:15714) 10.10.4.6:8080 [CLIENT|SSL|READ_CLOSED|WRITE_CLOSED|S_SSL_SHUT]
-
********* HTTP request log here:- **********

Code: Select all

2021 09 09 16:39:30.623 [160] network: accepted: client (10.10.4.6:15722) 10.10.4.6:8080 [fd:60]
2021 09 09 16:39:30.623 [160] header: debug: [request:1] header_get(client) client (10.10.4.6:15722) 10.10.4.6:8080:
HEAD http://www.example.com/ HTTP/1.1
Host: www.example.com
Proxy-Authorization: Basic bmlyYWo6TmlyYWpAMTIz
User-Agent: curl/7.58.0
Accept: */*
Proxy-Connection: Keep-Alive

2021 09 09 16:39:30.623 [160] category: debug: private categorization: categories :[none]
2021 09 09 16:39:30.623 [160] category: debug: categorize_using_global_db:651 ((not found))
2021 09 09 16:39:30.623 [160] category: module: debug: ssqore: hot cache[29]:hit url: www.example.com/
2021 09 09 16:39:30.623 [160] category: debug: ssqore:rate_request www.example.com/ [categories:1]
2021 09 09 16:39:30.623 [160] category: debug: ssqore:rate_request www.example.com/ [Consumer Electronics]
2021 09 09 16:39:30.623 [160] category: module: debug: ssqore:ssqore_req_profile [latency: 0.0200ms] www.example.com/
2021 09 09 16:39:30.623 [160] ldap: debug: set_dn:1034 ip:[10.10.4.6] user:[NIRAJ@SAFESQUID.TEST] DN:[CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test] Groups:[OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST]
2021 09 09 16:39:31.360 [160] network: debug: DNS[IPv4]: cache[miss] www.example.com -> 93.184.216.34
2021 09 09 16:39:31.360 [160] request: debug: [IP:10.10.4.6] client does not support encoded content
2021 09 09 16:39:31.360 [160] request: debug: auto request for encoded content
2021 09 09 16:39:31.360 [160] network: debug: ServerPool::Find common[miss]: http://():*@www.example.com:80 fd[-1]
2021 09 09 16:39:31.360 [160] network: debug: DNS[IPv4]: cache[hit] www.example.com -> 93.184.216.34
2021 09 09 16:39:31.360 [160] network: debug: connecting: www.example.com (ENOTCONN:0) 10.10.4.6:30515 [fd:61]
2021 09 09 16:39:31.360 [160] request: HEAD http://www.example.com:80/
2021 09 09 16:39:31.360 [160] header: debug: header_send: www.example.com (ENOTCONN:0) 10.10.4.6:30515
HEAD / HTTP/1.1
Accept: */*
User-Agent: curl/7.58.0
Host: www.example.com
Connection: keep-alive
Keep-Alive: timeout=6

2021 09 09 16:39:31.558 [160] header: debug: header_get_reconnect:859 timeout(6) www.example.com (ENOTCONN:0) 10.10.4.6:30515 www.example.com
2021 09 09 16:39:31.753 [160] network: connected: www.example.com (93.184.216.34:80) 10.10.4.6:30515 [fd:61]
2021 09 09 16:39:31.753 [160] header: debug: response headers from www.example.com (93.184.216.34:80) 10.10.4.6:30515:
HTTP/1.1 200 OK
Accept-Ranges: bytes
Age: 590441
Cache-Control: max-age=604800
Content-Type: text/html; charset=UTF-8
Date: Thu, 09 Sep 2021 11:09:31 GMT
Etag: "3147526947"
Expires: Thu, 16 Sep 2021 11:09:31 GMT
Last-Modified: Thu, 17 Oct 2019 07:18:26 GMT
Server: ECS (nyb/1D0F)
X-Cache: HIT
Content-Length: 1256

2021 09 09 16:39:31.753 [160] header: debug: header_send: client (10.10.4.6:15722) 10.10.4.6:8080
HTTP/1.1 200 OK
Accept-Ranges: bytes
Age: 590441
Date: Thu, 09 Sep 2021 11:09:31 GMT
Etag: "3147526947"
Server: ECS (nyb/1D0F)
Content-Type: text/html; charset=UTF-8
Content-Length: 1256
Cache-Control: max-age=604800
Expires: Thu, 16 Sep 2021 11:09:31 GMT
Last-Modified: Thu, 17 Oct 2019 07:18:26 GMT
Proxy-Connection: keep-alive
Keep-Alive: timeout=6
X-Cache: HIT, MISS from Safesquid 2021.0904.1613.3
X-Powered-By: safesquid-2021.0904.1613.3-swg-concept
X-SafeSquid-Client-ID: 160.1
X-SafeSquid-Categories: Consumer Electronics
X-SafeSquid-Request-Types: Unidentified Web2.0,Curl
X-SafeSquid-Application-Signatures: Unidentified Web2.0,Curl
X-SafeSquid-User-Groups: NETWORK_GROUP,OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST,CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test
X-URL-Cat: Consumer Electronics
X-Registered-Domain: example.com
X-SafeSquid-Request: http://www.example.com:80/

2021 09 09 16:39:31.753 [160] request: debug: protocol_http:448 HEAD: status[200:no content body expected]
2021 09 09 16:39:31.753 [160] network: Socket::server disconnecting: www.example.com (93.184.216.34:80) 10.10.4.6:30515 [xacts:1] [read:328.000B] [write:127.000B]
2021 09 09 16:39:31.753 [160] network: debug: ~Socket:656 s_shut www.example.com (93.184.216.34:80) 10.10.4.6:30515 [SERVER|NORMAL|READ_CLOSED|WRITE_CLOSED|S_NO_LINGER]
2021 09 09 16:39:31.753 [160] network: ClientPool::Add:145 close client (10.10.4.6:15722) 10.10.4.6:8080
2021 09 09 16:39:31.754 [160] network: Socket::client disconnecting: client (10.10.4.6:15722) 10.10.4.6:8080 [xacts:1] [read:181.000B] [write:941.000B]
2021 09 09 16:39:31.754 [160] network: debug: ~Socket:656 s_shut client (10.10.4.6:15722) 10.10.4.6:8080 [CLIENT|NORMAL|READ_CLOSED|WRITE_CLOSED]
------------------------------LOGS BELOW (After adding an extra policy at the last)-------------------------------
after policy.png
after policy.png (357.91 KiB) Viewed 1154 times
after.png
after.png (242.56 KiB) Viewed 1154 times
********* HTTPS request log here: - ***********

Code: Select all

2021 09 09 16:43:41.417 [165] network: accepted: client (10.10.4.6:15724) 10.10.4.6:8080 [fd:60]
2021 09 09 16:43:41.417 [165] header: debug: [request:1] header_get(client) client (10.10.4.6:15724) 10.10.4.6:8080:
CONNECT www.google.com:443 HTTP/1.1
Host: www.google.com:443
Proxy-Authorization: Basic bmlyYWo6TmlyYWpAMTIz
User-Agent: curl/7.58.0
Proxy-Connection: Keep-Alive

2021 09 09 16:43:41.417 [165] category: debug: private categorization: categories :[none]
2021 09 09 16:43:41.417 [165] category: debug: categorize_using_global_db:651 ((not found))
2021 09 09 16:43:41.417 [165] category: module: debug: ssqore: hot cache[29]:hit url: www.google.com/
2021 09 09 16:43:41.417 [165] category: debug: ssqore:rate_request www.google.com/ [categories:1]
2021 09 09 16:43:41.417 [165] category: debug: ssqore:rate_request www.google.com/ [Search Engines & Portals]
2021 09 09 16:43:41.417 [165] category: module: debug: ssqore:ssqore_req_profile [latency: 0.0200ms] www.google.com/
2021 09 09 16:43:41.417 [165] ldap: debug: set_dn:1034 ip:[10.10.4.6] user:[NIRAJ@SAFESQUID.TEST] DN:[CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test] Groups:[OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST]
2021 09 09 16:43:42.185 [165] network: debug: DNS[IPv4]: cache[miss] www.google.com -> 216.58.196.68
2021 09 09 16:43:42.185 [165] ssl: debug: SSLcertSection::check:2129 deep scan TRUE
2021 09 09 16:43:42.193 [165] ssl: debug: ClientEncrypt:2768 10.10.4.6:ready
2021 09 09 16:43:42.193 [165] ssl: debug: CTXcacheIN::set_default_ctx: cache:hit size[1] ref[0]
2021 09 09 16:43:42.193 [165] ssl: debug: CertPool::GetKey:5650 size[7] cache:hit domain:.google.com ret[1]
2021 09 09 16:43:42.197 [165] ssl: debug: session_ticket_cb_in:380 renew 10.10.4.6:15724 [www.google.com]
2021 09 09 16:43:42.197 [165] ssl: debug: session_ticket_cb_in:380 renew 10.10.4.6:15724 [www.google.com]
2021 09 09 16:43:42.197 [165] ssl: debug: Socket::EncryptC:1501 client (10.10.4.6:15724) 10.10.4.6:8080 [retry:1] [cache mode:770] [reused:no] www.google.com (TLS_AES_256_GCM_SHA384)
2021 09 09 16:43:42.197 [165] network: ClientPool::Add:145 idle client (10.10.4.6:15724) 10.10.4.6:8080
2021 09 09 16:43:42.197 [165] header: debug: [request:2] header_get(client) client (10.10.4.6:15724) 10.10.4.6:8080:
HEAD / HTTP/1.1
Host: www.google.com
User-Agent: curl/7.58.0
Accept: */*

2021 09 09 16:43:42.197 [165] category: debug: private categorization: categories :[none]
2021 09 09 16:43:42.197 [165] category: debug: categorize_using_global_db:651 ((not found))
2021 09 09 16:43:42.197 [165] category: module: debug: ssqore: hot cache[29]:hit url: www.google.com/
2021 09 09 16:43:42.197 [165] category: debug: ssqore:rate_request www.google.com/ [categories:1]
2021 09 09 16:43:42.197 [165] category: debug: ssqore:rate_request www.google.com/ [Search Engines & Portals]
2021 09 09 16:43:42.197 [165] category: module: debug: ssqore:ssqore_req_profile [latency: 0.0170ms] www.google.com/
2021 09 09 16:43:42.197 [165] ldap: debug: set_dn:1034 ip:[10.10.4.6] user:[NIRAJ@SAFESQUID.TEST] DN:[CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test] Groups:[OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST]
2021 09 09 16:43:42.197 [165] network: debug: DNS[IPv4]: cache[hit] www.google.com -> 216.58.196.68
2021 09 09 16:43:42.197 [165] request: debug: [IP:10.10.4.6] client does not support encoded content
2021 09 09 16:43:42.197 [165] request: debug: auto request for encoded content
2021 09 09 16:43:42.197 [165] network: debug: ServerPool::Find common[miss]: https://():*@www.google.com:443 fd[-1]
2021 09 09 16:43:42.197 [165] network: debug: DNS[IPv4]: cache[hit] www.google.com -> 216.58.196.68
2021 09 09 16:43:42.198 [165] network: debug: connecting: www.google.com (ENOTCONN:0) 10.10.4.6:36185 [fd:54]
2021 09 09 16:43:42.198 [165] ssl: debug: SSLcertSection::check:2129 deep scan TRUE
2021 09 09 16:43:42.199 [165] ssl: debug: CTXcacheOUT::ssl_out_setup:4928 cache[1] added: ref[1] www.google.com
2021 09 09 16:43:42.199 [165] ssl: debug: ssl_setup:1245 www.google.com:[0] ctx[OK] SSL[OK]
2021 09 09 16:43:42.199 [165] ssl: debug: Socket::EncryptS:1301 ENOTCONN:0 SSL_set_tlsext_host_name(www.google.com)
2021 09 09 16:43:42.206 [165] network: connected: www.google.com (216.58.196.68:443) 10.10.4.6:36185 [fd:54]
2021 09 09 16:43:42.293 [165] ssl: debug: Socket::EncryptS:1349 [site:www.google.com] [session reused:no] [retry:6]
2021 09 09 16:43:42.293 [165] ssl: debug: Socket::EncryptS:1358 www.google.com (216.58.196.68:443) 10.10.4.6:36185 (TLS_AES_256_GCM_SHA384)
2021 09 09 16:43:42.293 [165] ssl: debug: ServerEncrypt: www.google.com:443 Allowed: has ssl certificate
2021 09 09 16:43:42.293 [165] request: HEAD https://www.google.com:443/
2021 09 09 16:43:42.293 [165] header: debug: header_send: www.google.com (216.58.196.68:443) 10.10.4.6:36185
HEAD / HTTP/1.1
Accept: */*
User-Agent: curl/7.58.0
Host: www.google.com
Connection: keep-alive
Keep-Alive: timeout=6

2021 09 09 16:43:42.293 [165] header: debug: header_get_reconnect:859 timeout(6) www.google.com (216.58.196.68:443) 10.10.4.6:36185 www.google.com
2021 09 09 16:43:42.414 [165] header: debug: response headers from www.google.com (216.58.196.68:443) 10.10.4.6:36185:
HTTP/1.1 200 OK
Content-Type: text/html; charset=ISO-8859-1
P3P: CP="This is not a P3P policy! See g.co/p3phelp for more info."
Date: Thu, 09 Sep 2021 11:13:42 GMT
Server: gws
X-XSS-Protection: 0
X-Frame-Options: SAMEORIGIN
Transfer-Encoding: chunked
Expires: Thu, 09 Sep 2021 11:13:42 GMT
Cache-Control: private
Set-Cookie: 1P_JAR=2021-09-09-11; expires=Sat, 09-Oct-2021 11:13:42 GMT; path=/; domain=.google.com; Secure
Set-Cookie: NID=223=xbB7UH5VLWK3KS1PYaCCsGTimjvbRInx1IR278wPQJWWOxjOx_XNxEZAzfIQsRmThB4HCJtQEvBftiAi6yNLyeiWcUHpj62SKZJ4hyv0bakfKObQfobtQ-avMgLlBAr2lkfdoRhimEyxFmSDhBza5XvfIOOal-h6qRwSYgnoSxc; expires=Fri, 11-Mar-2022 11:13:42 GMT; path=/; domain=.google.com; HttpOnly
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"

2021 09 09 16:43:42.414 [165] cookie filter: debug: allowed: 10.10.4.6 <- www.google.com
2021 09 09 16:43:42.414 [165] cookie filter: debug: allowed: 10.10.4.6 <- www.google.com
2021 09 09 16:43:42.414 [165] header: debug: header_send: client (10.10.4.6:15724) 10.10.4.6:8080
HTTP/1.1 200 OK
P3P: CP="This is not a P3P policy! See g.co/p3phelp for more info."
Date: Thu, 09 Sep 2021 11:13:42 GMT
Server: gws
X-XSS-Protection: 0
X-Frame-Options: SAMEORIGIN
Set-Cookie: 1P_JAR=2021-09-09-11; domain=.google.com; path=/; expires=Sat, 09 Oct 2021 11:13:42 GMT; Secure
Set-Cookie: NID=223=xbB7UH5VLWK3KS1PYaCCsGTimjvbRInx1IR278wPQJWWOxjOx_XNxEZAzfIQsRmThB4HCJtQEvBftiAi6yNLyeiWcUHpj62SKZJ4hyv0bakfKObQfobtQ-avMgLlBAr2lkfdoRhimEyxFmSDhBza5XvfIOOal-h6qRwSYgnoSxc; domain=.google.com; path=/; expires=Fri, 11 Mar 2022 11:13:42 GMT; HttpOnly
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Content-Type: text/html; charset=ISO-8859-1
Transfer-Encoding: chunked
Cache-Control: private
Expires: Thu, 09 Sep 2021 11:13:42 GMT
Connection: keep-alive
Keep-Alive: timeout=6
X-Powered-By: safesquid-2021.0904.1613.3-swg-concept
X-SafeSquid-Client-ID: 165.2
X-SafeSquid-Categories: Search Engines & Portals
X-SafeSquid-Request-Types: Curl,Google
X-SafeSquid-Application-Signatures: Curl,Google
X-SafeSquid-User-Groups: NETWORK_GROUP,OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST,CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test
X-URL-Cat: Search Engines & Portals
X-Registered-Domain: google.com
X-SafeSquid-Request: https://www.google.com:443/
X-Cookie-Filter: Disabled
X-Cookie-Filter: Disabled

2021 09 09 16:43:42.414 [165] request: debug: protocol_http:448 HEAD: status[200:no content body expected]
2021 09 09 16:43:42.414 [165] network: Socket::server disconnecting: www.google.com (216.58.196.68:443) 10.10.4.6:36185 [xacts:1] [read:904.000B] [write:126.000B]
2021 09 09 16:43:42.414 [165] network: debug: ~Socket:617 s_shut www.google.com (216.58.196.68:443) 10.10.4.6:36185 [SERVER|SSL|S_SSL_SHUT|S_NO_LINGER]
2021 09 09 16:43:42.414 [165] network: debug: ~Socket:656 s_shut www.google.com (216.58.196.68:443) 10.10.4.6:36185 [SERVER|SSL|READ_CLOSED|WRITE_CLOSED|S_SSL_SHUT|S_NO_LINGER]
2021 09 09 16:43:42.414 [165] network: ClientPool::Add:145 close client (10.10.4.6:15724) 10.10.4.6:8080
2021 09 09 16:43:42.415 [165] network: Socket::client disconnecting: client (10.10.4.6:15724) 10.10.4.6:8080 [xacts:2] [read:248.000B] [write:1.639KB]
2021 09 09 16:43:42.415 [165] network: debug: ~Socket:617 s_shut client (10.10.4.6:15724) 10.10.4.6:8080 [CLIENT|SSL|S_SSL_SHUT]
2021 09 09 16:43:42.415 [165] network: debug: ~Socket:656 s_shut client (10.10.4.6:15724) 10.10.4.6:8080 [CLIENT|SSL|READ_CLOSED|WRITE_CLOSED|S_SSL_SHUT]
********* HTTP request log here: - ***********

Code: Select all

2021 09 09 16:45:41.450 [167] network: accepted: client (10.10.4.6:15726) 10.10.4.6:8080 [fd:41]
2021 09 09 16:45:41.451 [167] header: debug: [request:1] header_get(client) client (10.10.4.6:15726) 10.10.4.6:8080:
HEAD http://www.example.com/ HTTP/1.1
Host: www.example.com
Proxy-Authorization: Basic bmlyYWo6TmlyYWpAMTIz
User-Agent: curl/7.58.0
Accept: */*
Proxy-Connection: Keep-Alive

2021 09 09 16:45:41.451 [167] category: debug: private categorization: categories :[none]
2021 09 09 16:45:41.451 [167] category: debug: categorize_using_global_db:651 ((not found))
2021 09 09 16:45:41.451 [167] category: module: debug: ssqore: hot cache[29]:hit url: www.example.com/
2021 09 09 16:45:41.451 [167] category: debug: ssqore:rate_request www.example.com/ [categories:1]
2021 09 09 16:45:41.451 [167] category: debug: ssqore:rate_request www.example.com/ [Consumer Electronics]
2021 09 09 16:45:41.451 [167] category: module: debug: ssqore:ssqore_req_profile [latency: 0.0120ms] www.example.com/
2021 09 09 16:45:41.451 [167] ldap: debug: set_dn:1034 ip:[10.10.4.6] user:[NIRAJ@SAFESQUID.TEST] DN:[CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test] Groups:[OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST]
2021 09 09 16:45:43.100 [167] network: debug: DNS[IPv4]: cache[miss] www.example.com -> 93.184.216.34
2021 09 09 16:45:43.100 [167] request: debug: [IP:10.10.4.6] client does not support encoded content
2021 09 09 16:45:43.100 [167] request: debug: auto request for encoded content
2021 09 09 16:45:43.100 [167] network: debug: ServerPool::Find common[miss]: http://():*@www.example.com:80 fd[-1]
2021 09 09 16:45:43.100 [167] network: debug: DNS[IPv4]: cache[hit] www.example.com -> 93.184.216.34
2021 09 09 16:45:43.100 [167] network: debug: connecting: www.example.com (ENOTCONN:0) 10.10.4.6:18859 [fd:60]
2021 09 09 16:45:43.100 [167] request: HEAD http://www.example.com:80/
2021 09 09 16:45:43.101 [167] header: debug: header_send: www.example.com (ENOTCONN:0) 10.10.4.6:18859
HEAD / HTTP/1.1
Accept: */*
User-Agent: curl/7.58.0
Host: www.example.com
Connection: keep-alive
Keep-Alive: timeout=6

2021 09 09 16:45:43.304 [167] header: debug: header_get_reconnect:859 timeout(6) www.example.com (ENOTCONN:0) 10.10.4.6:18859 www.example.com
2021 09 09 16:45:43.509 [167] network: connected: www.example.com (93.184.216.34:80) 10.10.4.6:18859 [fd:60]
2021 09 09 16:45:43.509 [167] header: debug: response headers from www.example.com (93.184.216.34:80) 10.10.4.6:18859:
HTTP/1.1 200 OK
Accept-Ranges: bytes
Age: 528200
Cache-Control: max-age=604800
Content-Type: text/html; charset=UTF-8
Date: Thu, 09 Sep 2021 11:15:43 GMT
Etag: "3147526947"
Expires: Thu, 16 Sep 2021 11:15:43 GMT
Last-Modified: Thu, 17 Oct 2019 07:18:26 GMT
Server: ECS (nyb/1D0D)
X-Cache: HIT
Content-Length: 1256

2021 09 09 16:45:43.510 [167] header: debug: header_send: client (10.10.4.6:15726) 10.10.4.6:8080
HTTP/1.1 200 OK
Accept-Ranges: bytes
Age: 528200
Date: Thu, 09 Sep 2021 11:15:43 GMT
Etag: "3147526947"
Server: ECS (nyb/1D0D)
Content-Type: text/html; charset=UTF-8
Content-Length: 1256
Cache-Control: max-age=604800
Expires: Thu, 16 Sep 2021 11:15:43 GMT
Last-Modified: Thu, 17 Oct 2019 07:18:26 GMT
Proxy-Connection: keep-alive
Keep-Alive: timeout=6
X-Cache: HIT, MISS from Safesquid 2021.0904.1613.3
X-Powered-By: safesquid-2021.0904.1613.3-swg-concept
X-SafeSquid-Client-ID: 167.1
X-SafeSquid-Categories: Consumer Electronics
X-SafeSquid-Request-Types: Unidentified Web2.0,Curl
X-SafeSquid-Application-Signatures: Unidentified Web2.0,Curl
X-SafeSquid-User-Groups: NETWORK_GROUP,OU=Network Group V1 DC=safesquid DC=test,NIRAJ@SAFESQUID.TEST,CN=niraj n. niraj,OU=Network Group V1,DC=safesquid,DC=test
X-URL-Cat: Consumer Electronics
X-Registered-Domain: example.com
X-SafeSquid-Request: http://www.example.com:80/

2021 09 09 16:45:43.510 [167] request: debug: protocol_http:448 HEAD: status[200:no content body expected]
2021 09 09 16:45:43.510 [167] network: Socket::server disconnecting: www.example.com (93.184.216.34:80) 10.10.4.6:18859 [xacts:1] [read:328.000B] [write:127.000B]
2021 09 09 16:45:43.510 [167] network: debug: ~Socket:656 s_shut www.example.com (93.184.216.34:80) 10.10.4.6:18859 [SERVER|NORMAL|READ_CLOSED|WRITE_CLOSED|S_NO_LINGER]
2021 09 09 16:45:43.510 [167] network: ClientPool::Add:145 close client (10.10.4.6:15726) 10.10.4.6:8080
2021 09 09 16:45:43.510 [167] network: Socket::client disconnecting: client (10.10.4.6:15726) 10.10.4.6:8080 [xacts:1] [read:181.000B] [write:941.000B]
2021 09 09 16:45:43.510 [167] network: debug: ~Socket:656 s_shut client (10.10.4.6:15726) 10.10.4.6:8080 [CLIENT|NORMAL|READ_CLOSED|WRITE_CLOSED]