The Python web apps throw 500s
Dagobert Michelsen via buildfarm
buildfarm at lists.opencsw.org
Thu Sep 25 14:20:21 CEST 2014
Hi Maciej,
Am 25.09.2014 um 12:13 schrieb Maciej (Matchek) Bliziński via buildfarm <buildfarm at lists.opencsw.org>:
> 11:42 < lblume> automaciej: Is the REST thingie working? I've had troubles since yesterday with checkpkg
> 11:45 < automaciej> I don't know, I haven't logged in recently
> 11:45 < automaciej> show your error message
> 11:46 < automaciej> we had problems in which the web app would stop working, and you had to restart apache to fix it. but I don't know where the problem is exactly.
> 11:46 < automaciej> s/fix/mitigate/
> 11:49 < lblume> automaciej: ib.python.rest.RestCommunicationError: http://buildfarm.opencsw.org/releases/blob/elfdump/elib.python.rest.RestCommunicationError:
> http://buildfarm.opencsw.org/releases/blob/elfdump/eec39f8f198b88684667bd0fe98b56ec/ - HTTP code: 500
> 12:08 < automaciej> nothing in error_log
> 12:09 < automaciej> svcadm restart cswapache2; try again
>
> We've seen this in the past too. I can't debug this now, but it's a recurring problem, and we should try to debug this some time. It could be in Apache, or in the web app itself. But I the problem is I don't understand why we're not seeing these errors in error_log.
>
> less /opt/csw/apache2/var/log/buildfarm.opencsw.org-error_log
There are lots of errors in there:
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 420, in _delegate
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] return handle_class(cls)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 396, in handle_class
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] return tocall(*args)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/home/web/bin/gar/lib/web/releases_web.py", line 451, in PUT
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] content_md5_sum=content_md5_sum)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1226, in __init__
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] self._create(id, **kw)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1274, in _create
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] self._SO_finishCreate(id)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1298, in _SO_finishCreate
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] id, names, values)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 468, in queryInsertID
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] return self._runWithConnection(self._queryInsertID, soInstance, id, names, values)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 327, in _runWithConnection
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] val = meth(conn, *args)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 155, in _queryInsertID
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] self._executeRetry(conn, c, q)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 121, in _executeRetry
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] raise OperationalError(ErrorMessage(e))
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] OperationalError: Got a packet bigger than 'max_allowed_packet' bytes
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] Traceback (most recent call last):
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 239, in process
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] return self.handle()
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 230, in handle
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] return self._delegate(fn, self.fvars, args)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 420, in _delegate
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] return handle_class(cls)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 396, in handle_class
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] return tocall(*args)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/home/web/bin/gar/lib/web/releases_web.py", line 451, in PUT
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] content_md5_sum=content_md5_sum)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1226, in __init__
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] self._create(id, **kw)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1274, in _create
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] self._SO_finishCreate(id)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1298, in _SO_finishCreate
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] id, names, values)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 468, in queryInsertID
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] return self._runWithConnection(self._queryInsertID, soInstance, id, names, values)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 327, in _runWithConnection
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] val = meth(conn, *args)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 155, in _queryInsertID
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] self._executeRetry(conn, c, q)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 121, in _executeRetry
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] raise OperationalError(ErrorMessage(e))
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] OperationalError: Got a packet bigger than 'max_allowed_packet' bytes
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]
[Thu Sep 25 14:07:46 2014] [info] [client 62.210.215.117] (32)Broken pipe: core_output_filter: writing data to the network
Best regards
— Dago
--
"You don't become great by trying to be great, you become great by wanting to do something,
and then doing it so hard that you become great in the process." - xkcd #896
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opencsw.org/pipermail/buildfarm/attachments/20140925/debe1037/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2418 bytes
Desc: not available
URL: <http://lists.opencsw.org/pipermail/buildfarm/attachments/20140925/debe1037/attachment-0001.p7s>
More information about the buildfarm
mailing list