Domino on Linux/Unix, Troubleshooting, Best Practices, Tips and more ...

Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

Daniel Nashed  20 July 2015 06:05:44
One of my customers and another partner reported a new crash when applying 9.0.1 FP4 IF1.
They both reported the exact same call-stack both running on Linux. I have no details yet but given the fact that there are two independent crash reports with the same call-stack this might be a more general issue.


I am waiting for more information and will update you ASAP once I hear anything new.
For now I would stay on the last IF of FP3 until we know what is happening.


Enclosed you find the call-stack for reference.

Update 13.08.2015:

IBM is working on a fix. One of my customers got a hotfix. It is not clear what is exactly broken.
But we also found some other details and a work-around.

It turns out that IBM moved from Dojo 1.5.2 to 1.5.4 in FP4.
The file owner is not set correctly in those new Dojo files. I have one Linux customer and one AIX customer where fixing the file-permissions did help to avoid the crash and also to get other functionality in XPages and other applications working again.

The permissions looked like this:

/local/notesdata/domino/js/dojo-1.5.4

[root@mail dojo-1.5.4]# ll
total 20
drwxr-xr-x. 12 10537 6001 4096 Jun  8 11:10 dijit
drwxr-xr-x. 13 10537 6001 4096 Jun  8 11:11 dojo
drwxr-xr-x. 53 10537 6001 4096 Jun  8 11:11 dojox
drwxr-xr-x.  5 10537 6001 4096 Jun  8 11:11 dwa
drwxr-xr-x.  5 10537 6001 4096 Jun  8 11:11 ibm

Changing them via chown -R notes:notes /local/notesdata/domino/js/dojo-1.5.4 did help in our case.
But the hotfix my Linux customer got, did fix it in some other way, because after applying the hotfix the file owners have been still wrong.


-- Daniel





Thread 44 (Thread 0x7fa2b8429700 (LWP 14306)):

#0  0x00007fa354c1c063 in select () from /lib64/libc.so.6

#1  0x00007fa355d6db47 in FRDoSleep (secs=, usecs=) at cleanup.c:986

#2  0x00007fa355d6e812 in OSRunExternalScript (

   passed_script=0x7fa2b841b340 "\"/export/opt/ibm/domino/notes/latest/linux/nsd.sh\" -batch -crashpid 12669 -crashtid 3091371776", flags=) at cleanup.c:4037

#3  0x00007fa355d6fba3 in OSFaultCleanupExt (action2take=0, CleanupScriptExecFlag=,
   iniFileName=0x0, szProcess=, Length=, CrashedPID=0x0) at cleanup.c:1574

#4  0x00007fa355d6ffaf in OSFaultCleanup (action2take=0, CleanupScriptExecFlag=0, iniFileName=0x0)

   at cleanup.c:1322

#5  0x00007fa355d3d9c0 in fatal_error (signl=11, info=, context=) at break.c:2519

#6  0x00007fa3006c4438 in jsig_handler ()

  from /export/opt/ibm/domino/notes/latest/linux/jvm/lib/amd64/default/libjsig.so

#7  0x00007fa30021132f in masterSynchSignalHandler ()

  from /export/opt/ibm/domino/notes/latest/linux/jvm/lib/amd64/default/libj9prt24.so

#8  

#9  0x00007fa354bafb32 in fgets () from /lib64/libc.so.6

#10 0x00007fa35433fa0f in Haiku::GetLastModified (this=, pNote=,
   argc=, argv=, argl=, rethResult=0x7fa2b841f22c,
   retResultLength=0x7fa2b841f228) at haiku/haiku.cpp:17170

#11 0x00007fa35430a864 in Haiku::AtFuncDispatch::ExecuteDbCommand (this=, pHaiku=,
   note=0x7fa2b8423480, index=, argc=1421540096, argv=0x7fa354ebbef8 ,
   argl=0x7fa2b8421340, bIsJsData=1, bIsHTML=0) at haiku/haiku.cpp:32883

#12 0x00007fa35430ab7e in Haiku::ExecuteDbCommand (this=, note=,
   nCmd=, argc=, argv=, argl=, bIsJsData=1,
   bIsHTML=0) at haiku/haiku.cpp:4731

#13 0x00007fa3543923e9 in HuDocNote::AddHaikuDbCommand (this=0x7fa2b8423480, iCmd=89, args=..., bIsJsData=1,
   bIsHTML=0) at haiku/HuDocNote.cpp:5549

#14 0x00007fa354481eb7 in ShBuiltInNameSpaceTag::Write (this=0x2c27148, formStream=0x7fa2b84235c0, layoutBody=...)

   at haiku/ShBodyParts.cpp:904

#15 0x00007fa3543e66b7 in HuLayout::WriteContents (this=0x7fa2b48ccdd8, formStream=0x7fa2b84235c0)

   at haiku/HuLayout.cpp:285

#16 0x00007fa354396727 in HuDocNote::GenerateHTML (this=0x7fa2b8423480, html=...) at haiku/HuDocNote.cpp:2589

#17 0x00007fa35433bad7 in Haiku::GenerateHtml (this=0x7fa2b8423470) at haiku/haiku.cpp:3964

#18 0x00007fa354373fd6 in Haiku::HandleDominoCmd (this=0x7fa2b8423470, cmd=...) at haiku/HandleOpenDoc.cpp:192

#19 0x00007fa35433ec30 in Haiku::HandleCmd (cmd=0x7fa2b48b6dd8, cmdHandler=...) at haiku/haiku.cpp:3441

#20 0x00007fa354144fbc in CmdHandlerBase::PrivHandle (this=0x7fa3026cc038, cmd=0x7fa2b48b6dd8, cachedCmd=0x0)

   at cmdhandb.cpp:129

#21 0x00007fa354144037 in CmdHandler::PrivHandle (this=0x7fa3026cc038, cmd=0x7fa2b48b6dd8) at cmdhand.cpp:102

#22 0x00007fa354143ca2 in CmdHandler::Handler (cmd=0x7fa2b48b6dd8, data=) at cmdhand.cpp:153

#23 0x00007fa354135cf5 in Cmd::Execute (this=0x7fa2b841eaa0) at cmd.cpp:1166

#24 0x00007fa3541afe68 in InotesHTTPProcessRequestImpl (ihReq=0x7fa2b54c0f88) at inotesif.cpp:2488

#25 0x00007fa3541b050e in InotesHTTPProcessRequest (ihReq=0x7fa2b841eaa0) at inotesif.cpp:2053

#26 0x00007fa3592114f3 in HTInotesRequest::ProcessRequest (this=0x7fa2b54c0f70) at htinotes.cpp:1254

#27 0x00007fa35920946b in HTRequestExtContainer::ProcessRequest (this=0x7fa2b54c0b08, appSpace=)

   at htextcon.cpp:1262

#28 0x00007fa35922487d in HTRequest::ProcessRequest (this=0x7fa2b54c0878) at htrequst.cpp:1880

#29 0x00007fa35922dc20 in HTSession::StartRequest (this=0x7fa2b54d61b0) at htsesson.cpp:620

#30 0x00007fa359239276 in HTWorkerThread::CheckForWork (this=0x7fa2b4ae7de8) at htwrkthr.cpp:226

#31 0x00007fa35923949b in HTWorkerThread::ThreadMain (this=0x7fa2b4ae7de8) at htwrkthr.cpp:90

#32 0x00007fa359233331 in HTThreadBeginProc (arg=0x7fa2b4ae7de8) at htthread.cpp:39

#33 0x00007fa355d65383 in ThreadWrapper (Parameter=) at thread.c:1155

#34 0x00007fa3558617b6 in start_thread () from /lib64/libpthread.so.0

#35 0x00007fa354c22d6d in clone () from /lib64/libc.so.6

#36 0x0000000000000000 in ?? ()

Comments

1Mathieu Pape  22.07.2015 9:45:33  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

At the other end of the chain, the Notes client with fix pack 4 crashes when used a an IMAP client (I know, this is not so common but still). As soon as you replicate to collect your e-mail it simply kicks out... Uninstalled the FP and all is OK.

2Rene Bos  04.08.2015 0:28:04  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

same here after FP4 upgrade even with IF1

whenever someone tries to open inotes, server crashes

3Daniel Brix  06.08.2015 10:08:44  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

I am unable to reproduce the crash on windows 2008 64bit but on AIX 7.1.

Perhaps only an issue on linux / unix servers.

4Daniel Nashed  10.08.2015 10:44:46  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

Hey Daniel,

my Linux customer got a fix and I got some info about the potential problem as well from IBM.

The SPR is #SVRO9YLM35: iNotes crash in MAXSPRINTF.

I have not seen a IF for that but I guess they will have to address this issue soon as it sounds like it is a more general problem.

-- Daniel

5Daniel Brix  10.08.2015 20:31:20  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

Daniel, thank you for your feedback. The issue is also aimed at XPages because some dojo widgets are missing or file permissions are set incorrectly. A colleague tried under the guidance of IBM to correct the error. The crashes were fixed, but not the dojo problems. So we had to go back to FP3.

6Cameron Gregor  19.08.2015 6:25:55  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

Thanks Daniel! This helped us diagnose our server crash, will try changing permissions...

7Torben Volkmann  26.09.2015 23:20:45  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

Is anybody still having the problem with FP4 IF2? My server is still crashing

8Johannes Erk  29.09.2015 14:35:59  Crash on iNotes when applying IF1 or the new 9.0.1 FP4 version

Changing permissions worked like a charm. Great work, thank you! :)

Archives


  • [IBM Lotus Domino]
  • [Domino on Linux]
  • [Nash!Com]
  • [Daniel Nashed]