telsur-lb:~ # nginx -t
nginx: [warn] conflicting server name "192.168.100.60" on 0.0.0.0:80, ignored
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful
I'm not sure about the questions, I have only done what we have done here but before someone else had it. I add the results of the commands
I can understand your frustration. But, your system is behaving odd. We should easily be able to see that root-test.txt file and we cannot. That is usually a simple matter to get working.
Something started going wrong after Aug25. Your system was renewing your certs every week for a long time until then. No certs for this domain have been created since Aug25. Was anything important changed between Aug25 and Sept2?
Right now your nginx config needs change. You have two server definitions using the same name which should not be. Can you put it back the way it was with the two server sections with "listen 80;". See your post #9. You had a server defined for "localhost" in your nginx.conf and you had a server defined for "192.168.100.60" defined in here:
/etc/nginx/conf.d/load-balancer.conf
So,
Put back the "localhost" server definition unless you know you do not want it anymore.
Decide where you want the server definition for the "198.168..." server and delete the one you do not want. Make sure the one that remains has the 3 lines for "location" of the well-known URI that I provided.
After your changes, do
nginx -t
service nginx restart
nginx -T
And again put 3 backticks before and after each command results
Also try:
systemctl status nginx -l
And, let's make sure the root test file still exists:
ls -l /srv/www/htdocs/root-test*
I know this is a lot but something odd is happening. We need to have a consistent and cleanly working nginx to proceed to more detailed checks.
Do you have a backup of that file from before Aug26? Maybe there is some special processing it did that would explain why this all stopped working on that date.
telsur-lb:~ # nginx -t
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful
You have new mail in /var/mail/root
telsur-lb:~ # service nginx restart
You have new mail in /var/mail/root
telsur-lb:~ # nginx -t
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful
telsur-lb:~ # systemctl status nginx -l
● nginx.service - The nginx HTTP and reverse proxy server
Loaded: loaded (/usr/lib/systemd/system/nginx.service; enabled; vendor preset:>
Active: active (running) since Thu 2021-12-09 12:13:28 PST; 1min 6s ago
Process: 11877 ExecStartPre=/usr/sbin/nginx -t (code=exited, status=0/SUCCESS)
Main PID: 11878 (nginx)
Tasks: 2
CGroup: /system.slice/nginx.service
├─11878 nginx: master process /usr/sbin/nginx -g daemon off;
└─11879 nginx: worker process
Dec 09 12:13:28 telsur-lb systemd[1]: Starting The nginx HTTP and reverse proxy s>
Dec 09 12:13:28 telsur-lb nginx[11877]: nginx: the configuration file /etc/nginx/>
Dec 09 12:13:28 telsur-lb nginx[11877]: nginx: configuration file /etc/nginx/ngin>
Dec 09 12:13:28 telsur-lb systemd[1]: Started The nginx HTTP and reverse proxy se>
You have new mail in /var/mail/root
telsur-lb:~ # ls -l /srv/www/htdocs/root-test*
-rw-r--r-- 1 root root 52 Dec 8 21:11 /srv/www/htdocs/root-test.txt
telsur-lb:~ # curl -i http://192.168.100.60/root-test.txt
HTTP/1.1 404 Not Found
Server: nginx/1.14.0
Date: Thu, 09 Dec 2021 20:24:56 GMT
Content-Type: text/html; charset=utf-8
Transfer-Encoding: chunked
Connection: keep-alive
Vary: accept-language,accept-charset,Accept-Encoding
Accept-Ranges: bytes
Content-Language: en
Expires: Thu, 09 Dec 2021 20:24:56 GMT
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<title>Object not found!</title>
<link rev="made" href="mailto:admin@company.com" />
<style type="text/css"><!--/*--><![CDATA[/*><!--*/
body { color: #000000; background-color: #FFFFFF; }
a:link { color: #0000CC; }
p, address {margin-left: 3em;}
span {font-size: smaller;}
/*]]>*/--></style>
</head>
<body>
<h1>Object not found!</h1>
<p>
The requested URL was not found on this server.
If you entered the URL manually please check your
spelling and try again.
</p>
<p>
If you think this is a server error, please contact
the <a href="mailto:admin@company.com">webmaster</a>.
</p>
<h2>Error 404</h2>
<address>
<a href="/">192.168.100.60</a><br />
<span>Apache</span>
</address>
</body>
</html>
Well, I just made a number of requests to your domain name with http and https and none of them show in the access log (update: that log was later removed from prior post). Examples:
I do not know how this can happen. It seems like this nginx you are showing is not the one receiving requests for that domain name. It looks like it should but it is not.
I need a break to think about what I suggest next.
Oh, you do not need to delete those logs. It will be better to leave them for reference until problem resolved.
=================
I also am not sure why the 404 error message is formatted like it is. It is not the default error page format and you do not have any custom error pages defined for 4xx error codes. Can you try to find the source for that error?
Maybe try commands like these:
grep -ri 'Object not found!' /srv
grep -ri 'Object not found!' /etc
even try just / instead of /srv or /etc but it will probably take a very long time so just try other folders in your system that might have sources if that is too much.