i am getting around 10 dumps a second. The dump analysis is below. It looks like Service Broker may be involved. We do use service broker so that is a possibility.
Can anyone read this and make more sense out of it? Is there another command i can use that will produce more useful information?
this is SQL2005 so calling MS is probably not a good option.
(edit) it certainly looks like a background task (Service Broker)
(edit2) if it matters this is Sql2005 clustered on Win2008R2
CSession @0x00000003305B22B0----------------------------
m_spid = 156 m_cRef = 12 m_rgcRefType[0] = 1
m_pstackBhfPool = 0x0000000000000000 m_dwLoginFlags = 0x0000 m_fBackground = -1
In other stack dumps i have found, that value is a 0. -1 apparently indicates 'true'.
*******************************************************************************
* *
* Exception Analysis *
* *
*******************************************************************************
*** WARNING: Unable to verify checksum for mscorlib.ni.dll
FAULTING_IP:
sqlservr!GenGetFromObject+91
00000000`023fa991 488b4500 mov rax,qword ptr [rbp]
EXCEPTION_RECORD: ffffffffffffffff -- (.exr 0xffffffffffffffff)
ExceptionAddress: 00000000023fa991 (sqlservr!GenGetFromObject+0x0000000000000091)
ExceptionCode: c0000005 (Access violation)
ExceptionFlags: 00000000
NumberParameters: 2
Parameter[0]: 0000000000000000
Parameter[1]: 0000000000000000
Attempt to read from address 0000000000000000
CONTEXT: 0000000000000000 -- (.cxr 0x0;r)
rax=0000000000000000 rbx=0000000000000000 rcx=000000002f347580
rdx=0000000000000000 rsi=0000000000000064 rdi=0000000000002e1c
rip=0000000076e212fa rsp=000000003a0ea2d8 rbp=0000000000000001
r8=0000000000000001 r9=000000002f347580 r10=0000000000000000
r11=000000003a0e93a8 r12=000000003a0ea308 r13=000000003a0ec8c0
r14=0000000000001d4c r15=000000012f717a83
iopl=0 nv up ei ng nz na po cy
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000287
ntdll!NtWaitForSingleObject+0xa:
00000000`76e212fa c3 ret
DEFAULT_BUCKET_ID: WRONG_SYMBOLS
PROCESS_NAME: sqlservr.exe
ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%08lx referenced memory at 0x%08lx. The memory could not be %s.
EXCEPTION_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%08lx referenced memory at 0x%08lx. The memory could not be %s.
EXCEPTION_PARAMETER1: 0000000000000000
EXCEPTION_PARAMETER2: 0000000000000000
READ_ADDRESS: 0000000000000000
FOLLOWUP_IP:
sqlservr!GenGetFromObject+91
00000000`023fa991 488b4500 mov rax,qword ptr [rbp]
NTGLOBALFLAG: 0
APP: sqlservr.exe
ANALYSIS_VERSION: 6.3.9600.17029 (debuggers(dbg).140219-1702) amd64fre
MANAGED_STACK: !dumpstack -EE
No export dumpstack found
PRIMARY_PROBLEM_CLASS: WRONG_SYMBOLS
BUGCHECK_STR: APPLICATION_FAULT_WRONG_SYMBOLS
LAST_CONTROL_TRANSFER: from 00000000023fbe22 to 00000000023fa991
STACK_TEXT:
00000000`3a0ecfe0 00000000`023fbe22 : 00000002`6ceb8050 00000000`00000000 00000007`c9768150 00000008`9c6608c0 : sqlservr!GenGetFromObject+0x91
00000000`3a0ed050 00000000`0242450d : 00000007`c9768110 00000002`50b4beb0 ffffffff`fffffffe 00000000`01618b9b : sqlservr!XRelGenGet+0x22
00000000`3a0ed0a0 00000000`02425231 : 00000002`50b4bfb0 00000008`9c6608c0 00000002`6ceb8050 00000000`024118b1 : sqlservr!CStmtRecvMsg::GenGetCGLockWhereConvGroup+0x15d
00000000`3a0ed1b0 00000000`029744ec : 00000007`9b3c69f0 00000007`9b3c69f0 00000002`a3858140 00000000`01715375 : sqlservr!CStmtRecvMsg::GenMessageGet+0xe1
00000000`3a0ed240 00000000`0299ca63 : 00000002`569d33b0 00000002`f324da00 00000002`f324da00 00000002`68f1f1e0 : sqlservr!CStmtRecvMsg::BuildBoundQuery+0x19c
00000000`3a0ed310 00000000`0152f239 : 00000007`9b3c6320 00000000`00337588 00000002`6ceb8050 00000000`01644e24 : sqlservr!CStmtRecvMsg::FBind+0x73
00000000`3a0ed380 00000000`01565dbe : 00000007`6f16a5a0 00000006`a11f09c0 00000000`0124c400 00000002`0000111b : sqlservr!CProchdr::FNormalizeStep+0x389
00000000`3a0edae0 00000000`0176d7e1 : 00000000`00000000 00000000`015b9121 00000000`3a0ee380 ffffffff`fffffffe : sqlservr!CSQLSource::FCompile+0x60e
00000000`3a0edd70 00000000`015b97eb : 00000000`3a0ee380 00000002`f324da00 00000002`f324da00 00000000`3a0ee380 : sqlservr!CSQLSource::FCompWrapper+0x121
00000000`3a0ede30 00000000`015cc4c1 : 00000000`00000000 00000008`61052b00 00000003`00000000 00000000`0000011b : sqlservr!CSQLSource::Transform+0x35b
00000000`3a0edef0 00000000`02b9829c : 00000000`00000000 00000008`610521c0 00000000`80d7a960 00000000`00000000 : sqlservr!CSQLSource::Execute+0x291
00000000`3a0ee040 00000000`02bad4e8 : 00000008`61052080 00000000`00000070 00000008`61052570 00000000`01627718 : sqlservr!CSbActivationTask::Invoke+0x44c
00000000`3a0ee970 00000000`02bad7d9 : 00000000`00000000 00000000`0aff8080 00000000`0aff4768 00000008`610521c0 : sqlservr!CSbTask::TaskStart+0x278
00000000`3a0efaa0 00000000`015c483e : ffffffff`ffffffff 00000000`00000000 00000000`00000000 00000000`0aff4750 : sqlservr!CSbTask::BeginTaskStart+0x9
00000000`3a0efad0 00000000`015c4ad9 : 00000000`00000000 00000000`0aff8080 00000000`0aff4718 00000000`0aff8080 : sqlservr!SOS_Task::Param::Execute+0xee
00000000`3a0efbe0 00000000`015bb254 : 00000000`0aff4718 00000000`00000000 00000000`0aff8080 00000008`610521c0 : sqlservr!SOS_Scheduler::RunTask+0xc9
00000000`3a0efc70 00000000`014d4687 : 00000008`610521c0 00000000`00338270 000007ff`fff314a8 00000000`0aff8080 : sqlservr!SOS_Scheduler::ProcessTasks+0xb4
00000000`3a0efce0 00000000`017be7b9 : 00000008`610521c0 00000000`0aff8080 00000000`00000000 00000000`00000788 : sqlservr!SchedulerManager::WorkerEntryPoint+0xe7
00000000`3a0efd80 00000000`017be585 : 00000000`3a0efdf0 00000000`00000200 00000000`00000000 00000000`3a0efda0 : sqlservr!SystemThread::RunWorker+0x59
00000000`3a0efdc0 00000000`017eade8 : 00000000`00000000 00000000`00000000 00000000`003b6b00 00000000`00000000 : sqlservr!SystemThreadDispatcher::ProcessWorker+0xb5
00000000`3a0efe60 00000000`746e37d7 : 000007ff`fff314a8 00000000`00000000 00000000`00000000 00000000`00000000 : sqlservr!SchedulerManager::ThreadEntryPoint+0x128
00000000`3a0eff00 00000000`746e3894 : 00000000`747995c0 00000000`04397f60 00000000`00000000 00000000`00000000 : msvcr80!endthreadex+0x47
00000000`3a0eff30 00000000`76cc59ed : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : msvcr80!endthreadex+0x104
00000000`3a0eff60 00000000`76dfc541 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : kernel32!BaseThreadInitThunk+0xd
00000000`3a0eff90 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : ntdll!RtlUserThreadStart+0x1d
STACK_COMMAND: ~0s; .ecxr ; kb
SYMBOL_STACK_INDEX: 0
SYMBOL_NAME: sqlservr!GenGetFromObject+91
FOLLOWUP_NAME: MachineOwner
MODULE_NAME: sqlservr
IMAGE_NAME: sqlservr.exe
DEBUG_FLR_IMAGE_TIMESTAMP: 4d02b641
FAILURE_BUCKET_ID: WRONG_SYMBOLS_c0000005_sqlservr.exe!GenGetFromObject
BUCKET_ID: X64_APPLICATION_FAULT_WRONG_SYMBOLS_sqlservr!GenGetFromObject+91
ANALYSIS_SOURCE: UM
FAILURE_ID_HASH_STRING: um:wrong_symbols_c0000005_sqlservr.exe!gengetfromobject
FAILURE_ID_HASH: {f8a83b33-1e6a-af53-1838-793e524bdc68}
-- dan http://dnhlmssql.blogspot.com/