On Tue, Jun 26, 2018 at 7:59 PM, Richard Mudgett <rmudgett at digium.com> wrote:> > > On Tue, Jun 26, 2018 at 6:15 PM, Dovid Bender <dovid at telecurve.com> wrote: > >> I have Asterisk running on a Ubuntu 18.0.4 on Digital Ocean. Every so >> often asterisk crashes and then restarts. I am not seeing any core dumps on >> the box. The only I thing I see every time is a second before Asterisk >> crashes there is a AAAA lookup for the boxes hostname. As soon as it gets >> the response I see that asterisk is restarting. Any idea what would cause >> this and how would get a dump or further debug? I did build Asterisk with >> DONT_OPTIMIZE and BETTER_BACKTRACES but not seeing any traces anywhere. I >> am using Asterisk 15.4.1. >> > > You have to start asterisk with the -g option to make asterisk create core > files. > https://wiki.asterisk.org/wiki/display/AST/Getting+a+Backtrace > > Richard > > It's very strange. So when I try to start asterisk via systemd I get:root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# systemctl start asterisk Job for asterisk.service failed because a timeout was exceeded. See "systemctl status asterisk.service" and "journalctl -xe" for details. root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# ps aux | grep aster root 14412 0.1 0.5 25084 5208 pts/2 S+ 10:52 0:00 nano /lib/systemd/system/asterisk.service asterisk 14425 9.3 4.7 1304352 48144 ? Ssl 10:52 0:00 /usr/sbin/asterisk -g -f -U asterisk root 14526 0.0 0.0 14856 976 pts/0 S+ 10:52 0:00 grep --color=auto aster root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# As you can see it's still working. If I then connect to the console asterisk is running fine, in this case Asterisk restarts randomly (every 1-2 minutes). If I then start asterisk myself by doing: /usr/sbin/asterisk -g -f -U asterisk Then it starts fine and works with no issue. It would seem there is something with systemd that is causing Asterisk to restart. I don't think it's the actual script since I would then expect it to always restart at the same time though I am not able to find any dumps any where on the box. Any ideas? -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.digium.com/pipermail/asterisk-users/attachments/20180627/1b443556/attachment.html>
On Wed, Jun 27, 2018 at 5:15 AM Dovid Bender <dovid at telecurve.com> wrote:> > > On Tue, Jun 26, 2018 at 7:59 PM, Richard Mudgett <rmudgett at digium.com> > wrote: > >> >> >> On Tue, Jun 26, 2018 at 6:15 PM, Dovid Bender <dovid at telecurve.com> >> wrote: >> >>> I have Asterisk running on a Ubuntu 18.0.4 on Digital Ocean. Every so >>> often asterisk crashes and then restarts. I am not seeing any core dumps on >>> the box. The only I thing I see every time is a second before Asterisk >>> crashes there is a AAAA lookup for the boxes hostname. As soon as it gets >>> the response I see that asterisk is restarting. Any idea what would cause >>> this and how would get a dump or further debug? I did build Asterisk with >>> DONT_OPTIMIZE and BETTER_BACKTRACES but not seeing any traces anywhere. I >>> am using Asterisk 15.4.1. >>> >> >> You have to start asterisk with the -g option to make asterisk create >> core files. >> https://wiki.asterisk.org/wiki/display/AST/Getting+a+Backtrace >> >> Richard >> >> It's very strange. So when I try to start asterisk via systemd I get: > root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# > systemctl start asterisk > Job for asterisk.service failed because a timeout was exceeded. > See "systemctl status asterisk.service" and "journalctl -xe" for details. > root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# > root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# > root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# ps aux > | grep aster > root 14412 0.1 0.5 25084 5208 pts/2 S+ 10:52 0:00 nano > /lib/systemd/system/asterisk.service > asterisk 14425 9.3 4.7 1304352 48144 ? Ssl 10:52 0:00 > /usr/sbin/asterisk -g -f -U asterisk > root 14526 0.0 0.0 14856 976 pts/0 S+ 10:52 0:00 grep > --color=auto aster > root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# > > As you can see it's still working. If I then connect to the console > asterisk is running fine, in this case Asterisk restarts randomly (every > 1-2 minutes). If I then start asterisk myself by doing: > /usr/sbin/asterisk -g -f -U asterisk > > Then it starts fine and works with no issue. It would seem there is > something with systemd that is causing Asterisk to restart. I don't think > it's the actual script since I would then expect it to always restart at > the same time though I am not able to find any dumps any where on the box. > > Any ideas? >Look in /var/lib/asterisk. That's the home directory that the service file sets. Core files may be there. Run "sysctl kernel.core_pattern". That will tell you where the kernel will place the files. Did you previously install asterisk from apt and did you uninstall it before compiling and installing 15.4.1? The default version from apt is 13.18.3 so you may have a mixed installation that's causing issues. Run "dmesg" after asterisk dies. If it actually crashed, there'll be a message in the kernel log.> > > -- > _____________________________________________________________________ > -- Bandwidth and Colocation Provided by http://www.api-digital.com -- > > Check out the new Asterisk community forum at: > https://community.asterisk.org/ > > New to Asterisk? Start here: > https://wiki.asterisk.org/wiki/display/AST/Getting+Started > > asterisk-users mailing list > To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users-- George Joseph Digium, Inc. | Software Developer 445 Jan Davis Drive NW - Huntsville, AL 35806 - US Check us out at: www.digium.com & www.asterisk.org -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.digium.com/pipermail/asterisk-users/attachments/20180627/de2179ba/attachment.html>
On Wed, Jun 27, 2018 at 9:22 AM, George Joseph <gjoseph at digium.com> wrote:> > > On Wed, Jun 27, 2018 at 5:15 AM Dovid Bender <dovid at telecurve.com> wrote: > >> >> >> On Tue, Jun 26, 2018 at 7:59 PM, Richard Mudgett <rmudgett at digium.com> >> wrote: >> >>> >>> >>> On Tue, Jun 26, 2018 at 6:15 PM, Dovid Bender <dovid at telecurve.com> >>> wrote: >>> >>>> I have Asterisk running on a Ubuntu 18.0.4 on Digital Ocean. Every so >>>> often asterisk crashes and then restarts. I am not seeing any core dumps on >>>> the box. The only I thing I see every time is a second before Asterisk >>>> crashes there is a AAAA lookup for the boxes hostname. As soon as it gets >>>> the response I see that asterisk is restarting. Any idea what would cause >>>> this and how would get a dump or further debug? I did build Asterisk with >>>> DONT_OPTIMIZE and BETTER_BACKTRACES but not seeing any traces anywhere. I >>>> am using Asterisk 15.4.1. >>>> >>> >>> You have to start asterisk with the -g option to make asterisk create >>> core files. >>> https://wiki.asterisk.org/wiki/display/AST/Getting+a+Backtrace >>> >>> Richard >>> >>> It's very strange. So when I try to start asterisk via systemd I get: >> root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# >> systemctl start asterisk >> Job for asterisk.service failed because a timeout was exceeded. >> See "systemctl status asterisk.service" and "journalctl -xe" for details. >> root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# >> root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# >> root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# ps >> aux | grep aster >> root 14412 0.1 0.5 25084 5208 pts/2 S+ 10:52 0:00 nano >> /lib/systemd/system/asterisk.service >> asterisk 14425 9.3 4.7 1304352 48144 ? Ssl 10:52 0:00 >> /usr/sbin/asterisk -g -f -U asterisk >> root 14526 0.0 0.0 14856 976 pts/0 S+ 10:52 0:00 grep >> --color=auto aster >> root at fingerprint1:/var/lib/lxcfs/cgroup/name=systemd/system.slice# >> >> As you can see it's still working. If I then connect to the console >> asterisk is running fine, in this case Asterisk restarts randomly (every >> 1-2 minutes). If I then start asterisk myself by doing: >> /usr/sbin/asterisk -g -f -U asterisk >> >> Then it starts fine and works with no issue. It would seem there is >> something with systemd that is causing Asterisk to restart. I don't think >> it's the actual script since I would then expect it to always restart at >> the same time though I am not able to find any dumps any where on the box. >> >> Any ideas? >> > > Look in /var/lib/asterisk. That's the home directory that the service > file sets. Core files may be there. > Run "sysctl kernel.core_pattern". That will tell you where the kernel > will place the files. > > Did you previously install asterisk from apt and did you uninstall it > before compiling and installing 15.4.1? The default version from apt is > 13.18.3 so you may have a mixed installation that's causing issues. > > Run "dmesg" after asterisk dies. If it actually crashed, there'll be a > message in the kernel log. > > > >> >>I did install Asterisk from source after I used apt-get. Any time in the past when I installed Asterisk and then installed a new version the newer version worked with no issue. I did an apt-get remove and now it seems the issues cleared up. Thanks for the help. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.digium.com/pipermail/asterisk-users/attachments/20180627/e7fd8fb3/attachment.html>