Backup Sharepoint Online with Azure functions - azure

Is there a way to generate a sharepoint backup online using azure functions?
I have already authenticated the tenant using managed identity
The idea would be to download all the files in the documents and upload them to an azure storage account
I used this code but I get an error:
using namespace System.Net
param($Request, $TriggerMetadata)
$TenantSiteURL = "https://tenant.sharepoint.com"
$SiteRelativeURL = "/sites/BackupSource"
$LibraryName = "Documenti Condivisi"
$DownloadPath ="\Temp\Docs"
#Connect-PnPOnline -ManagedIdentity
Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity
Write-Warning "Connesso"
#Set-Location -Path SPO:\$SiteRelativeURL
Get-PnPMicrosoft365Group
Push-OutputBinding -Name Response -Value ([HttpResponseContext]#{
StatusCode = [HttpStatusCode]::OK
})
2022-01-03T16:58:32.983 [Information] Executing 'Functions.HttpTrigger1' (Reason='This function was programmatically called via the host APIs.', Id=09c1fe95-6b6e-4e85-8c8f-815e37e99d04)
2022-01-03T16:58:40.915 [Information] OUTPUT:
2022-01-03T16:58:41.541 [Information] OUTPUT: Account SubscriptionName TenantId Environment
2022-01-03T16:58:41.542 [Information] OUTPUT: ------- ---------------- -------- -----------
2022-01-03T16:58:41.549 [Information] OUTPUT: MSI#50342 --- AzureCloud
2022-01-03T16:58:41.549 [Information] OUTPUT:
2022-01-03T16:58:43.530 [Error] ERROR: Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.Exception :Type : System.Management.Automation.ParameterBindingExceptionMessage : Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.ErrorId : AmbiguousParameterSetLine : 13Offset : 1CommandInvocation :MyCommand : Connect-PnPOnlineBoundParameters :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys : …Values : …SyncRoot : …ScriptLineNumber : 13OffsetInLine : 1HistoryId : 1ScriptName : C:\home\site\wwwroot\HttpTrigger1\run.ps1Line : Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentityPositionMessage : At C:\home\site\wwwroot\HttpTrigger1\run.ps1:13 char:1+ Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~PSScriptRoot : C:\home\site\wwwroot\HttpTrigger1PSCommandPath : C:\home\site\wwwroot\HttpTrigger1\run.ps1InvocationName : Connect-PnPOnlinePipelineLength : 1PipelinePosition : 1CommandOrigin : InternalErrorRecord :Exception :Type : System.Management.Automation.ParentContainsErrorRecordExceptionMessage : Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.HResult : -2146233087CategoryInfo : InvalidArgument: (:) [Connect-PnPOnline], ParentContainsErrorRecordExceptionFullyQualifiedErrorId : AmbiguousParameterSet,PnP.PowerShell.Commands.Base.ConnectOnlineInvocationInfo :MyCommand : Connect-PnPOnlineScriptLineNumber : 13OffsetInLine : 1HistoryId : 1ScriptName : C:\home\site\wwwroot\HttpTrigger1\run.ps1Line : Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentityPositionMessage : At C:\home\site\wwwroot\HttpTrigger1\run.ps1:13 char:1+ Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~PSScriptRoot : C:\home\site\wwwroot\HttpTrigger1PSCommandPath : C:\home\site\wwwroot\HttpTrigger1\run.ps1CommandOrigin : InternalScriptStackTrace : at <ScriptBlock>, C:\home\site\wwwroot\HttpTrigger1\run.ps1: line 13TargetSite :Name : ThrowAmbiguousParameterSetExceptionDeclaringType : System.Management.Automation.CmdletParameterBinderController, System.Management.Automation, Version=7.0.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35MemberType : MethodModule : System.Management.Automation.dllStackTrace :at System.Management.Automation.CmdletParameterBinderController.ThrowAmbiguousParameterSetException(UInt32 parameterSetFlags, MergedCommandParameterMetadata bindableParameters)at System.Management.Automation.CmdletParameterBinderController.ValidateParameterSets(Boolean prePipelineInput, Boolean setDefault)at System.Management.Automation.CmdletParameterBinderController.BindCommandLineParametersNoValidation(Collection`1 arguments)at System.Management.Automation.CmdletParameterBinderController.BindCommandLineParameters(Collection`1 arguments)at System.Management.Automation.CommandProcessor.BindCommandLineParameters()at System.Management.Automation.CommandProcessor.Prepare(IDictionary psDefaultParameterValues)at System.Management.Automation.CommandProcessorBase.DoPrepare(IDictionary psDefaultParameterValues)at System.Management.Automation.Internal.PipelineProcessor.Start(Boolean incomingStream)at System.Management.Automation.Internal.PipelineProcessor.SynchronousExecuteEnumerate(Object input)--- End of stack trace from previous location where exception was thrown ---at System.Management.Automation.Internal.PipelineProcessor.SynchronousExecuteEnumerate(Object input)at System.Management.Automation.PipelineOps.InvokePipeline(Object input, Boolean ignoreInput, CommandParameterInternal[][] pipeElements, CommandBaseAst[] pipeElementAsts, CommandRedirection[][] commandRedirections, FunctionContext funcContext)at System.Management.Automation.Interpreter.ActionCallInstruction`6.Run(InterpretedFrame frame)at System.Management.Automation.Interpreter.EnterTryCatchFinallyInstruction.Run(InterpretedFrame frame)Data : System.Collections.ListDictionaryInternalSource : System.Management.AutomationHResult : -2146233087CategoryInfo : InvalidArgument: (:) [Connect-PnPOnline], ParameterBindingExceptionFullyQualifiedErrorId : AmbiguousParameterSet,PnP.PowerShell.Commands.Base.ConnectOnlineInvocationInfo :MyCommand : Connect-PnPOnlineScriptLineNumber : 13OffsetInLine : 1HistoryId : 1ScriptName : C:\home\site\wwwroot\HttpTrigger1\run.ps1Line : Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentityPositionMessage : At C:\home\site\wwwroot\HttpTrigger1\run.ps1:13 char:1+ Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~PSScriptRoot : C:\home\site\wwwroot\HttpTrigger1PSCommandPath : C:\home\site\wwwroot\HttpTrigger1\run.ps1CommandOrigin : InternalScriptStackTrace : at <ScriptBlock>, C:\home\site\wwwroot\HttpTrigger1\run.ps1: line 13Microsoft.Azure.WebJobs.Script.Workers.Rpc.RpcException : Result: ERROR: Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.Exception :Type : System.Management.Automation.ParameterBindingExceptionMessage : Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.ErrorId : AmbiguousParameterSetLine : 13Offset : 1CommandInvocation :MyCommand : Connect-PnPOnlineBoundParameters :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys :Length : 3Length : 15Values :Length : 30IsPresent : TrueSyncRoot :Comparer : System.OrdinalIgnoreCaseComparerCount : 2Keys : …Values : …SyncRoot : …ScriptLineNumber : 13OffsetInLine : 1HistoryId : 1ScriptName : C:\home\site\wwwroot\HttpTrigger1\run.ps1Line : Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentityPositionMessage : At C:\home\site\wwwroot\HttpTrigger1\run.ps1:13 char:1+ Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~PSScriptRoot : C:\home\site\wwwroot\HttpTrigger1PSCommandPath : C:\home\site\wwwroot\HttpTrigger1\run.ps1InvocationName : Connect-PnPOnlinePipelineLength : 1PipelinePosition : 1CommandOrigin : InternalErrorRecord :Exception :Type : System.Management.Automation.ParentContainsErrorRecordExceptionMessage : Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.HResult : -2146233087CategoryInfo : InvalidArgument: (:) [Connect-PnPOnline], ParentContainsErrorRecordExceptionFullyQualifiedErrorId : AmbiguousParameterSet,PnP.PowerShell.Commands.Base.ConnectOnlineInvocationInfo :MyCommand : Connect-PnPOnlineScriptLineNumber : 13OffsetInLine : 1HistoryId : 1ScriptName : C:\home\site\wwwroot\HttpTrigger1\run.ps1Line : Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentityPositionMessage : At C:\home\site\wwwroot\HttpTrigger1\run.ps1:13 char:1+ Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~PSScriptRoot : C:\home\site\wwwroot\HttpTrigger1PSCommandPath : C:\home\site\wwwroot\HttpTrigger1\run.ps1CommandOrigin : InternalScriptStackTrace : at <ScriptBlock>, C:\home\site\wwwroot\HttpTrigger1\run.ps1: line 13TargetSite :Name : ThrowAmbiguousParameterSetExceptionDeclaringType : System.Management.Automation.CmdletParameterBinderController, System.Management.Automation, Version=7.0.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35MemberType : MethodModule : System.Management.Automation.dllStackTrace :at System.Management.Automation.CmdletParameterBinderController.ThrowAmbiguousParameterSetException(UInt32 parameterSetFlags, MergedCommandParameterMetadata bindableParameters)at System.Management.Automation.CmdletParameterBinderController.ValidateParameterSets(Boolean prePipelineInput, Boolean setDefault)at System.Management.Automation.CmdletParameterBinderController.BindCommandLineParametersNoValidation(Collection`1 arguments)at System.Management.Automation.CmdletParameterBinderController.BindCommandLineParameters(Collection`1 arguments)at System.Management.Automation.CommandProcessor.BindCommandLineParameters()at System.Management.Automation.CommandProcessor.Prepare(IDictionary psDefaultParameterValues)at System.Management.Automation.CommandProcessorBase.DoPrepare(IDictionary psDefaultParameterValues)at System.Management.Automation.Internal.PipelineProcessor.Start(Boolean incomingStream)at System.Management.Automation.Internal.PipelineProcessor.SynchronousExecuteEnumerate(Object input)--- End of stack trace from previous location where exception was thrown ---at System.Management.Automation.Internal.PipelineProcessor.SynchronousExecuteEnumerate(Object input)at System.Management.Automation.PipelineOps.InvokePipeline(Object input, Boolean ignoreInput, CommandParameterInternal[][] pipeElements, CommandBaseAst[] pipeElementAsts, CommandRedirection[][] commandRedirections, FunctionContext funcContext)at System.Management.Automation.Interpreter.ActionCallInstruction`6.Run(InterpretedFrame frame)at System.Management.Automation.Interpreter.EnterTryCatchFinallyInstruction.Run(InterpretedFrame frame)Data : System.Collections.ListDictionaryInternalSource : System.Management.AutomationHResult : -2146233087CategoryInfo : InvalidArgument: (:) [Connect-PnPOnline], ParameterBindingExceptionFullyQualifiedErrorId : AmbiguousParameterSet,PnP.PowerShell.Commands.Base.ConnectOnlineInvocationInfo :MyCommand : Connect-PnPOnlineScriptLineNumber : 13OffsetInLine : 1HistoryId : 1ScriptName : C:\home\site\wwwroot\HttpTrigger1\run.ps1Line : Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentityPositionMessage : At C:\home\site\wwwroot\HttpTrigger1\run.ps1:13 char:1+ Connect-PnPOnline -Url $TenantSiteURL -ManagedIdentity+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~PSScriptRoot : C:\home\site\wwwroot\HttpTrigger1PSCommandPath : C:\home\site\wwwroot\HttpTrigger1\run.ps1CommandOrigin : InternalScriptStackTrace : at <ScriptBlock>, C:\home\site\wwwroot\HttpTrigger1\run.ps1: line 13Exception: Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided.Stack: at System.Management.Automation.CmdletParameterBinderController.ThrowAmbiguousParameterSetException(UInt32 parameterSetFlags, MergedCommandParameterMetadata bindableParameters)at System.Management.Automation.CmdletParameterBinderController.ValidateParameterSets(Boolean prePipelineInput, Boolean setDefault)at System.Management.Automation.CmdletParameterBinderController.BindCommandLineParametersNoValidation(Collection`1 arguments)at System.Management.Automation.CmdletParameterBinderController.BindCommandLineParameters(Collection`1 arguments)at System.Management.Automation.CommandProcessor.BindCommandLineParameters()at System.Management.Automation.CommandProcessor.Prepare(IDictionary psDefaultParameterValues)at System.Management.Automation.CommandProcessorBase.DoPrepare(IDictionary psDefaultParameterValues)at System.Management.Automation.Internal.PipelineProcessor.Start(Boolean incomingStream)at System.Management.Automation.Internal.PipelineProcessor.SynchronousExecuteEnumerate(Object input)--- End of stack trace from previous location where exception was thrown ---at System.Management.Automation.Internal.PipelineProcessor.SynchronousExecuteEnumerate(Object input)at System.Management.Automation.PipelineOps.InvokePipeline(Object input, Boolean ignoreInput, CommandParameterInternal[][] pipeElements, CommandBaseAst[] pipeElementAsts, CommandRedirection[][] commandRedirections, FunctionContext funcContext)at System.Management.Automation.Interpreter.ActionCallInstruction`6.Run(InterpretedFrame frame)at System.Management.Automation.Interpreter.EnterTryCatchFinallyInstruction.Run(InterpretedFrame frame)
2022-01-03T16:58:43.540 [Warning] WARNING: Connesso
2022-01-03T16:58:43.657 [Error] ERROR: There is currently no connection yet. Use Connect-PnPOnline to connect.


There is no PowerShell command available for backup and restore in SharePoint Online.
Use the recycle bin and version history.
Use a 3rd party tool for backup and restore like SharePoint farm to Azure with MABS .
Manually backup sites, lists, and libraries (Information
about manual migration of SharePoint Online
content
Create a Microsoft 365 support request (Restore options in
SharePoint Online)
Backup solutions for SharePoint online here
you can back up a SharePoint online Azure with MABS. Refer here

Related

What can cause an MFC OpenInventor program to freeze inside nvwgf2umx.dll

I am currently facing the hardest bug chase of my young developer career. The software we provide is used only in the company internally having several hundred users / computers, but only on one the software does not work. The problematic program is based on MFC and uses OpenInventor for 3D visualisation.
When the user starts the software and creates a new file, internally a new CDocument is created connect to a view that uses/displays an SoWinFullViewer. The user can see that frame of the MFC view is created but the SoWinFullViewer is not displayed. In this state the whole application freezes.
I am unable to reproduce the issue on my developing machine or on any other computer.
For debugging, I deployed an debug build on the problematic computer. But the debug build runs fine. So I deployed a release build with debugging symboles and used the Remote Debugger from Visual Studio. When I start the release build via Remote Debugger everything works fine. If I start the program first on the problematic computer manually, then attach the process via Remote Debugger and then create the new file, the program freezes. After pausing the program, the debugger stands always in a thread of nvwgf2umx.dll.
I expected an issue with the GPU driver, so I let the IT reinstalled the GPU drivers. The problem stayed alive. The only option I see right now is to let the IT reinstall the whole system - praying that this will solve the issue.
What can I do for further debugging? What can cause an application to freeze inside nvwgf2umx.dll ?
Based on the comment I pulled a dump and analyzed it with WinDbg. This is the result of
!analyze -v :
Microsoft (R) Windows Debugger Version 10.0.22000.194 AMD64
Copyright (c) Microsoft Corporation. All rights reserved.
Loading Dump File [S:\_PROJECTS-GL\_DEP_L-D\L-DL\L-DL-FSCC\_Home\zimmde1\_Scratch\lisa (3).DMP]
User Mini Dump File with Full Memory: Only application data is available
Symbol search path is: srv*
Executable search path is:
Windows 10 Version 19042 MP (12 procs) Free x64
Product: WinNt, suite: SingleUserTS
Edition build lab: 19041.1.amd64fre.vb_release.191206-1406
Machine Name:
Debug session time: Tue Jan 11 08:45:35.000 2022 (UTC + 1:00)
System Uptime: 0 days 22:16:14.694
Process Uptime: 0 days 1:39:10.000
................................................................
................................................................
.....
Loading unloaded module list
.
For analysis of this file, run !analyze -v
ntdll!NtWaitForAlertByThreadId+0x14:
00007ffe`0c250764 c3 ret
0:000> .symfix
0:000> .sympath+ E:\Sandboxes\HeliosBuild\build\VS2012\Release\binx64
Symbol search path is: srv*;E:\Sandboxes\HeliosBuild\build\VS2012\Release\binx64
Expanded Symbol search path is: cache*;SRV*https://msdl.microsoft.com/download/symbols;e:\sandboxes\heliosbuild\build\vs2012\release\binx64
************* Path validation summary **************
Response Time (ms) Location
Deferred srv*
OK E:\Sandboxes\HeliosBuild\build\VS2012\Release\binx64
0:000> .sympath+ https://driver-symbols.nvidia.com/
Symbol search path is: srv*;E:\Sandboxes\HeliosBuild\build\VS2012\Release\binx64;https://driver-symbols.nvidia.com/
Expanded Symbol search path is: cache*;SRV*https://msdl.microsoft.com/download/symbols;e:\sandboxes\heliosbuild\build\vs2012\release\binx64;https://driver-symbols.nvidia.com/
************* Path validation summary **************
Response Time (ms) Location
Deferred srv*
OK E:\Sandboxes\HeliosBuild\build\VS2012\Release\binx64
Deferred https://driver-symbols.nvidia.com/
0:000> .srcpath+ E:\Sandboxes\HeliosBuild\src
Source search path is: E:\Sandboxes\HeliosBuild\src
************* Path validation summary **************
Response Time (ms) Location
OK E:\Sandboxes\HeliosBuild\src
0:000> ld*
Symbols loaded for nvoglv64
Symbols loaded for sysfer
[...]
Symbols already loaded for ntdll
0:000> .reload
................................................................
................................................................
.....
Loading unloaded module list
.
0:000> !analyze -v
*******************************************************************************
* *
* Exception Analysis *
* *
*******************************************************************************
*** WARNING: Unable to verify checksum for InventorBase.dll
*** WARNING: Unable to verify checksum for Inventor.dll
*** WARNING: Unable to verify checksum for InventorGui.dll
*** WARNING: Unable to verify checksum for InventorWin.dll
*** WARNING: Unable to verify checksum for lisa.exe
*** WARNING: Unable to verify checksum for InventorGL.dll
*** WARNING: Unable to verify checksum for lsvdialog.dll
KEY_VALUES_STRING: 1
Key : Analysis.CPU.mSec
Value: 2078
Key : Analysis.DebugAnalysisManager
Value: Create
Key : Analysis.Elapsed.mSec
Value: 16761
Key : Analysis.Init.CPU.mSec
Value: 4280
Key : Analysis.Init.Elapsed.mSec
Value: 492749
Key : Analysis.Memory.CommitPeak.Mb
Value: 289
Key : Timeline.OS.Boot.DeltaSec
Value: 80174
Key : Timeline.Process.Start.DeltaSec
Value: 5950
Key : WER.OS.Branch
Value: vb_release
Key : WER.OS.Timestamp
Value: 2019-12-06T14:06:00Z
Key : WER.OS.Version
Value: 10.0.19041.1
Key : WER.Process.Version
Value: 1.62.0.0
NTGLOBALFLAG: 0
PROCESS_BAM_CURRENT_THROTTLED: 0
PROCESS_BAM_PREVIOUS_THROTTLED: 0
APPLICATION_VERIFIER_FLAGS: 0
EXCEPTION_RECORD: (.exr -1)
ExceptionAddress: 0000000000000000
ExceptionCode: 80000003 (Break instruction exception)
ExceptionFlags: 00000000
NumberParameters: 0
FAULTING_THREAD: 00000138
PROCESS_NAME: lisa.exe
ERROR_CODE: (NTSTATUS) 0x80000003 - {AUSNAHME} Haltepunkt Im Quellprogramm wurde ein Haltepunkt erreicht.
EXCEPTION_CODE_STR: 80000003
STACK_TEXT:
0000007f`ecb8aa58 00007ffe`0c1d9205 : 000001b7`f99a8610 000001b7`f9e56f60 00007ffd`d77616c0 00007ffe`09e74f69 : ntdll!NtWaitForAlertByThreadId+0x14
0000007f`ecb8aa60 00007ffe`0c2289bb : 00000000`00000000 00000000`00000000 00007ffe`0c32f3f0 00000000`00000000 : ntdll!RtlAcquireSRWLockExclusive+0x165
0000007f`ecb8aad0 00007ffe`0c201276 : 0000007f`ecb8b270 0000007f`ecb8ad80 00000000`00000000 00000000`00000000 : ntdll!RtlpCallVectoredHandlers+0x87
0000007f`ecb8ab70 00007ffe`0c250bfe : 00000000`00000000 00000000`00e400ff 00007ffe`0c32f3f0 00000000`00000000 : ntdll!RtlDispatchException+0x66
0000007f`ecb8ad80 00007ffe`0c2289d7 : 00000000`00000000 00000000`00000000 00000000`0000000c 00000000`00000000 : ntdll!KiUserExceptionDispatch+0x2e
0000007f`ecb8b490 00007ffe`0c201276 : 0000007f`ecb8bc30 0000007f`ecb8b740 00000000`00000000 000001b7`f1d32200 : ntdll!RtlpCallVectoredHandlers+0xa3
0000007f`ecb8b530 00007ffe`0c250bfe : 000001b7`f4a5acd0 00000000`00000000 fe5fffff`ffffffff 000001b7`f4c42430 : ntdll!RtlDispatchException+0x66
0000007f`ecb8b740 00007ffe`0c1b445c : 00007ffe`0c1db86b 00000000`00730019 00000000`000000c7 000001b7`f996a1e0 : ntdll!KiUserExceptionDispatch+0x2e
0000007f`ecb8be58 00007ffe`0c1db86b : 00000000`00730019 00000000`000000c7 000001b7`f996a1e0 0000007f`ecb8c1b0 : ntdll!RtlpLfhFindClearBitAndSet+0x8c
0000007f`ecb8be60 00007ffe`0c1db3c7 : 000001b7`efc40000 00007ffd`00000000 00000000`00000008 00000000`00000000 : ntdll!RtlpLowFragHeapAllocFromContext+0x21b
0000007f`ecb8bf20 00000000`6c065e2a : 00000000`00000000 00000000`00000008 0000007f`ecb8c4b0 0000007f`ecb80000 : ntdll!RtlpAllocateHeapInternal+0x9a7
0000007f`ecb8c030 00007ffd`d77063b7 : 00000000`00000008 00000000`00000000 0000007f`ecb8c2c0 00007ffd`c655a8bc : nvoglv64!DllMain+0xfe7a
0000007f`ecb8c060 00007ffd`cef83c64 : 000001b7`f1bed128 00000000`00000000 000001b7`f99a8610 00007ffd`c656733e : msvcr110!malloc+0x5b
0000007f`ecb8c090 00007ffd`cefbbeb1 : 000001b7`f1bed128 00000000`00000004 0000007f`ecb8c180 ffffffff`ffffffff : InventorBase!safeMalloc+0x44
0000007f`ecb8c0d0 00007ffd`cefbc418 : 00000000`00000013 0000b287`bfaab405 0000007f`ecb8c2c0 000001b7`f99a8610 : InventorBase!SbString::toStdWString+0x91
0000007f`ecb8c160 00007ffd`c695c8a8 : 000001b7`f4c96440 000001b7`f1bed128 00000000`00000000 00000000`00000007 : InventorBase!SbString::toWideChar+0x58
0000007f`ecb8c1c0 00007ffd`c696c458 : 00000000`00000000 00000000`00000000 000001b7`f99a8610 00000000`81000b8a : Inventor!SoVRMLWorldInfo::getTypeId+0x187e8
0000007f`ecb8c4c0 00007ffd`c6991aa9 : 00000000`00000013 0000007f`ecb8c6a0 00000000`00000013 000001b7`03c20000 : Inventor!SoContextedObjectCache<SoGLBufferObjectCache>::removeSharedGroupDependency+0x8498
0000007f`ecb8c530 00007ffd`c698eeb0 : 00000000`00000013 00000000`803b0000 000001b7`f99a8610 00007ffd`c658c2cb : Inventor!SoFontServer::getCurrentBBoxCache+0x149
0000007f`ecb8c5f0 00007ffd`c63cfe4c : 0000007f`ecb8c890 00007ffd`c654e1d2 0000007f`803e0000 0000007f`803e0000 : Inventor!SoFontServer::computeStringBoxInfo+0x490
0000007f`ecb8c750 00007ffd`c681f650 : 00000000`00000001 0000007f`ecb8c890 000001b7`f9b6b828 00000000`00000000 : Inventor!SoFontServer::computeStringBoxInfo+0x1c
0000007f`ecb8c790 00007ffd`c680ef8d : 000001b7`f9b4aa70 00000000`00000000 000001b7`f9b6b730 000001b7`efb6b2b0 : Inventor!SoText2::GLRender+0x160
0000007f`ecb8ca20 00007ffd`c6442615 : 000001b7`f9b4aa70 000001b7`efb6b1e0 000001b7`f9b4aa70 000001b7`f9b6b730 : Inventor!SoShape::GLRenderP+0x12d
0000007f`ecb8caf0 00007ffd`c671ea52 : 000001b7`f99c7ec0 000001b7`81f900a2 00000000`00000000 000001b7`f9b4aa70 : Inventor!SoAction::traverse+0xb5
0000007f`ecb8cb20 00007ffd`c66cb4fb : 00000000`00000000 00000000`00000001 000001b7`f9b97090 00000000`00000000 : Inventor!SoGroupImpl::GLRender+0x152
0000007f`ecb8cb90 00007ffd`c67e8216 : 000001b7`f9b97090 000001b7`f99c35e0 000001b7`00000002 00000000`00000001 : Inventor!SoCachedGroupImpl::GLRender+0x23b
0000007f`ecb8cc40 00007ffd`c6442615 : 000001b7`f9b4aa70 00000000`00000007 000001b7`f9b6aff0 000001b7`f9b6aff0 : Inventor!SoSeparator::GLRenderBelowPath+0x106
0000007f`ecb8cc80 00007ffd`c671ea52 : 000001b7`f99c75c0 000001b7`815e0007 00000000`00000000 000001b7`f9b4aa70 : Inventor!SoAction::traverse+0xb5
0000007f`ecb8ccb0 00007ffd`c66cb4fb : 00000000`00000000 00000000`00000001 000001b7`f9b97090 00000000`00000000 : Inventor!SoGroupImpl::GLRender+0x152
0000007f`ecb8cd20 00007ffd`c67e8216 : 000001b7`f9b97090 000001b7`f99c35e0 00000000`00000002 00000000`00000001 : Inventor!SoCachedGroupImpl::GLRender+0x23b
0000007f`ecb8cdd0 00007ffd`c6442615 : 000001b7`f9b4aa70 00000000`00000007 000001b7`f99c0820 000001b7`f99c0820 : Inventor!SoSeparator::GLRenderBelowPath+0x106
0000007f`ecb8ce10 00007ffd`c671ea52 : 000001b7`f995f9e0 000001b7`815e0007 00000000`00000000 000001b7`f9b4aa70 : Inventor!SoAction::traverse+0xb5
0000007f`ecb8ce40 00007ffd`c66cb4fb : 00000000`00000000 00000000`00000001 000001b7`f9b97090 00000000`00000000 : Inventor!SoGroupImpl::GLRender+0x152
0000007f`ecb8ceb0 00007ffd`c67e8216 : 000001b7`f9b97090 000001b7`f99c35e0 000001b7`00000002 00000000`00000001 : Inventor!SoCachedGroupImpl::GLRender+0x23b
0000007f`ecb8cf60 00007ffd`c6442615 : 000001b7`f9b4aa70 00000000`000001d2 000001b7`f99be320 000001b7`f99be320 : Inventor!SoSeparator::GLRenderBelowPath+0x106
0000007f`ecb8cfa0 00007ffd`c671ea52 : 000001b7`f9960d00 000001b7`839e01d2 00000000`00000000 000001b7`f9b4aa70 : Inventor!SoAction::traverse+0xb5
0000007f`ecb8cfd0 00007ffd`c66cb4fb : 0000007f`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : Inventor!SoGroupImpl::GLRender+0x152
0000007f`ecb8d040 00007ffd`c67e8216 : 000001b7`f9b97090 00000000`00000000 000001b7`00000000 00000000`00000001 : Inventor!SoCachedGroupImpl::GLRender+0x23b
0000007f`ecb8d0f0 00007ffd`c6442615 : 000001b7`f9b4aa70 00000000`00000007 000001b7`f99c1e00 00000000`00000000 : Inventor!SoSeparator::GLRenderBelowPath+0x106
0000007f`ecb8d130 00007ffd`c6471bb2 : 000001b7`f99c1e00 000001b7`815e0007 0000007f`ecb8d198 000001b7`f99c35e0 : Inventor!SoAction::traverse+0xb5
0000007f`ecb8d160 00007ffd`c6441371 : 000001b7`f9b4aa70 000001b7`f99c1e00 000001b7`f99c1e00 000001b7`f9b4aa70 : Inventor!SoGLRenderAction::beginTraversal+0x472
0000007f`ecb8d1e0 00007ffd`c64716cb : 00000000`00000001 0000007f`ecb8d348 000001b7`f99c1e00 000001b7`f9b4aa70 : Inventor!SoAction::apply+0x181
0000007f`ecb8d290 00007ffd`c69cb08a : 000001b7`f99c1e00 000001b7`f9b4aa70 000001b7`f9abc8e0 000001b7`f9abc8e0 : Inventor!SoGLRenderAction::apply+0x20b
0000007f`ecb8d2e0 00007ffd`c6671ce4 : 0000007f`839e01d2 000001b7`f99c1e00 000001b7`f9abc8e0 00000000`00000000 : Inventor!SoLineHighlightRenderAction::apply+0x48a
0000007f`ecb8d390 00007ffd`c6670cdd : 000001b7`f9bd2350 000001b7`00000000 000001b7`00000000 000001b7`80e60000 : Inventor!SoMultiPassManagerImpl::removeAllTraversalPass+0x274
0000007f`ecb8d460 00007ffd`c644134d : 000001b7`80e60000 000001b7`f9b4aa70 00000000`80e60000 000001b7`80f00000 : Inventor!SoMultiPassManagerImpl::apply+0x36d
0000007f`ecb8d510 00007ffd`c64716f9 : 00000000`00000001 0000007f`ecb8d678 000001b7`f99c1e00 000001b7`f9b4aa70 : Inventor!SoAction::apply+0x15d
0000007f`ecb8d5c0 00007ffd`c69cb08a : 000001b7`f99c1e00 000001b7`f9b4aa70 000001b7`f9b4aa70 000001b7`f99c1e00 : Inventor!SoGLRenderAction::apply+0x239
0000007f`ecb8d610 00007ffd`c687abaf : 000001b7`f99a8610 000001b7`f99c1e00 00000000`80f20000 000001b7`f9abc8e0 : Inventor!SoLineHighlightRenderAction::apply+0x48a
0000007f`ecb8d6c0 00007ffd`c69aea6d : 000001b7`f999b640 000001b7`f999b640 00000000`00000000 000001b7`f4930550 : Inventor!SoDepthOfField::setParameters+0x154f
0000007f`ecb8d700 00007ffd`dbbdfd57 : 00000000`00000000 000001b7`f999b7c0 00000000`00000000 00000000`00000000 : Inventor!SoSceneManagerImpl::render+0x73d
0000007f`ecb8d870 00007ffd`dbbde0bc : 000001b7`f99bf420 000001b7`f99bf420 000001b7`f99bf420 0000007f`ecb8d979 : InventorGui!SoGuiViewer::doRendering+0x4e7
0000007f`ecb8d8d0 00007ffd`dbbd98c0 : 000001b7`f9b976f0 000001b7`f9b976f0 00000000`00000000 000001b7`f99bfc00 : InventorGui!SoGuiViewer::actualRedraw+0x62c
0000007f`ecb8d9e0 00007ffd`c9e4e486 : ffffffff`fffffffe 00000000`00000000 000001b7`f99bf420 000001b7`f99bf420 : InventorGui!SoGuiExaminerViewer::actualRedraw+0x230
0000007f`ecb8dac0 00007ffd`c9e0df50 : 00000000`00000002 00000000`00000000 0000007f`ecb8dc90 00000000`00060a00 : InventorWin!SoWinExaminerViewer::actualRedraw+0x26
0000007f`ecb8daf0 00007ffd`c9e0fee4 : 00000000`3f800000 00000000`00000000 0000007f`ecb8dc90 000001b7`f99bf420 : InventorWin!SoWinRenderArea::redraw+0x210
0000007f`ecb8db60 00007ffd`c9e1ade7 : 000001b7`f99bf420 000001b7`f99bf420 000001b7`f1cee020 00000000`00000000 : InventorWin!SoWinViewer::redraw+0x34
0000007f`ecb8db90 00007ffe`0b4be7e8 : 0000007f`ecb8de20 00007ffe`0c318fe0 00000000`00000001 00000000`00000000 : InventorWin!SoWinGLWidget::glxWindowProc+0x217
0000007f`ecb8dd20 00007ffe`0b4be47e : 000001b7`f994906c 00007ffd`c9e1abd0 00000000`00060a00 00007ffd`00000005 : user32!UserCallWinProcCheckWow+0x2f8
0000007f`ecb8deb0 00007ffd`c8f2f1b0 : 000001b7`f9949060 00000000`00000000 00000000`ffff0a39 00000000`ffff0a39 : user32!CallWindowProcW+0x8e
0000007f`ecb8df00 00007ffe`0b4be7e8 : 00000000`00000001 0000007f`ecb8e2b0 00000000`00000000 00000000`00000000 : opengl32!wglWndProc+0x2a0
0000007f`ecb8df70 00007ffe`0b4be36c : 0000007f`ecb8e2b0 00007ffd`c8f2ef10 00000000`00060a00 00000000`00000005 : user32!UserCallWinProcCheckWow+0x2f8
0000007f`ecb8e100 00007ffe`0b4d0f93 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : user32!DispatchClientMessage+0x9c
0000007f`ecb8e160 00007ffe`0c250ba4 : 00000000`00000229 00000000`00000000 0000007f`ecb8e840 00007ffe`0b4beb26 : user32!_fnDWORD+0x33
0000007f`ecb8e1c0 00007ffe`0a1c1124 : 00007ffe`0b4bdec3 00000000`00000040 00007ffe`0c250ba4 000001b7`efb8a8f0 : ntdll!KiUserCallbackDispatcherContinue
0000007f`ecb8e248 00007ffe`0b4bdec3 : 00000000`00000040 00007ffe`0c250ba4 000001b7`efb8a8f0 00000000`00000002 : win32u!NtUserMessageCall+0x14
0000007f`ecb8e250 00007ffe`0b4bcb53 : 00000000`00060a00 00000000`40000000 00000000`00000000 00000000`00000001 : user32!SendMessageWorker+0x823
0000007f`ecb8e2f0 00007ffe`0b4b9bed : 00007ffe`0b4b9bb0 00007ffe`0b4ce2b1 000001b7`f03cf780 00000000`00000083 : user32!RealDefWindowProcWorker+0x2c3
0000007f`ecb8e3f0 00007ffe`071cb889 : 00007ffe`0b4b9bb0 00000000`00000047 000001b7`f2010900 00000000`00000047 : user32!RealDefWindowProcA+0x3d
0000007f`ecb8e430 00007ffe`071e2f8e : 00000000`00060a00 0000007f`ecb8ed40 00000000`00000000 0000007f`ecb8ed40 : uxtheme!_ThemeDefWindowProc+0x609
0000007f`ecb8e610 00007ffe`0b4b9846 : 0000007f`ecb8e7a0 00007ffe`0b4c0d92 000001b7`f99bf420 00000000`00060a00 : uxtheme!ThemeDefWindowProcA+0xe
0000007f`ecb8e650 00007ffd`c9e1b2b3 : 000001b7`f99bf420 00000000`00060a00 00000000`00000047 00000000`007fecb8 : user32!DefWindowProcA+0x76
0000007f`ecb8e6a0 00007ffe`0b4be7e8 : 00000000`00000000 00000000`00000000 00000000`00000001 00000000`00000000 : InventorWin!SoWinGLWidget::glxWindowProc+0x6e3
0000007f`ecb8e830 00007ffe`0b4be47e : 000001b7`f2010900 00007ffd`c9e1abd0 00000000`00060a00 00007ffd`00000047 : user32!UserCallWinProcCheckWow+0x2f8
0000007f`ecb8e9c0 00007ffd`c8f2f1b0 : 000001b7`f9949060 00000000`00000000 00000000`ffff0a39 00000000`00000000 : user32!CallWindowProcW+0x8e
0000007f`ecb8ea10 00007ffe`0b4be7e8 : 00000000`00000001 00000000`01650222 00000000`00000000 00000000`00000000 : opengl32!wglWndProc+0x2a0
0000007f`ecb8ea80 00007ffe`0b4be36c : 00000000`01650222 00007ffd`c8f2ef10 00000000`00060a00 00007ffe`00000047 : user32!UserCallWinProcCheckWow+0x2f8
0000007f`ecb8ec10 00007ffe`0b4d60c0 : 00000000`00000000 00000000`00000000 00000000`00000000 00007ffe`0c250ba4 : user32!DispatchClientMessage+0x9c
0000007f`ecb8ec70 00007ffe`0c250ba4 : 00000000`00000000 0000007f`ecb8ed78 00000000`0002001e 000001b7`f03cf780 : user32!_fnINLPWINDOWPOS+0x30
STACK_COMMAND: ~0s; .ecxr ; kb
SYMBOL_NAME: nvoglv64!DllMain+fe7a
MODULE_NAME: nvoglv64
IMAGE_NAME: nvoglv64.dll
FAILURE_BUCKET_ID: BREAKPOINT_80000003_nvoglv64.dll!DllMain
OS_VERSION: 10.0.19041.1
BUILDLAB_STR: vb_release
OSPLATFORM_TYPE: x64
OSNAME: Windows 10
IMAGE_VERSION: 10.18.13.5456
FAILURE_ID_HASH: {4c63ad3f-1b0d-6f17-5a1f-34f55bfc2ead}
Followup: MachineOwner
---------
This tells me that a breakpoint in nvoglv64.dll was hit. The Stack Text shows only external code. What could cause that?
And the result of
!locks -v :
CritSec ntdll!RtlpProcessHeapsListLock+0 at 00007ffe0c318ce0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +efb402c0 at 000001b7efb402c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 2
CritSec +ef9b02c0 at 000001b7ef9b02c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +efed02c0 at 000001b7efed02c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec shell32!g_lockObject+0 at 00007ffe0aef84a0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +f17902c0 at 000001b7f17902c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +f20102c0 at 000001b7f20102c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +f1d27fe0 at 000001b7f1d27fe0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec ntmarta!gWrkrLock+0 at 00007ffe084cc800
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec ntmarta!gCacheLock+0 at 00007ffe084cc860
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec ntmarta!grgRightsNameCache+3f0 at 00007ffe084cd3b0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec ntmarta!grgRightsNameCache+520 at 00007ffe084cd4e0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +fb2c02c0 at 000001b7fb2c02c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec +fb6f02c0 at 000001b7fb6f02c0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec msvcrt!CrtLock_Setlocale+0 at 00007ffe0beff5b0
LockCount NOT LOCKED
RecursionCount 0
OwningThread 0
EntryCount 0
ContentionCount 0
CritSec msvcr110!wcmdln+148 at 00007ffdd7765b10
WaiterWoken No
LockCount 5
RecursionCount 1
OwningThread 30b0
EntryCount 0
ContentionCount 5
*** Locked
Scanned 16 critical sections
~*kvn
Call Site
win32u!NtUserGetMessage+0x14
user32!GetMessageA+0x46
InventorGL!SoWindowsPowerEventHandler
InventorBase!SbThread
msvcr110!beginthreadex+0x107
msvcr110!endthreadex+0x192
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
win32u!NtUserMsgWaitForMultipleObjectsEx+0x14
user32!RealMsgWaitForMultipleObjectsEx+0x1e
nvoglv64!DrvValidateVersion+0x332d
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForAlertByThreadId+0x14
ntdll!RtlpWaitOnAddressWithTimeout+0x81
ntdll!RtlpWaitOnAddress+0xae
ntdll!RtlpWaitOnCriticalSection+0xfd
ntdll!RtlpEnterCriticalSectionContended+0x1c4
ntdll!RtlEnterCriticalSection+0x42
msvcr110!freefls+0xde
ntdll!RtlpFlsDataCleanup+0x121
ntdll!LdrShutdownThread+0x48
ntdll!RtlExitUserThread+0x3e
ntdll!TppWorkerThread+0xc18
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForAlertByThreadId+0x14
ntdll!RtlpWaitOnAddressWithTimeout+0x81
ntdll!RtlpWaitOnAddress+0xae
ntdll!RtlpWaitOnCriticalSection+0xfd
ntdll!RtlpEnterCriticalSectionContended+0x1c4
ntdll!RtlEnterCriticalSection+0x42
msvcr110!freefls+0xde
ntdll!RtlpFlsDataCleanup+0x121
ntdll!LdrShutdownThread+0x48
ntdll!RtlExitUserThread+0x3e
ntdll!TppWorkerThread+0xc18
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForSingleObject+0x14
KERNELBASE!WaitForSingleObjectEx+0x8e
nvoglv64!DrvValidateVersion+0x7d8a
nvoglv64+0x7b299d
nvoglv64+0x7b2658
nvoglv64!DrvValidateVersion+0xa257
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForAlertByThreadId+0x14
ntdll!RtlpWaitOnAddressWithTimeout+0x81
ntdll!RtlpWaitOnAddress+0xae
ntdll!RtlpWaitOnCriticalSection+0xfd
ntdll!RtlpEnterCriticalSectionContended+0x1c4
ntdll!RtlEnterCriticalSection+0x42
msvcr110!freefls+0xde
ntdll!RtlpFlsDataCleanup+0x121
ntdll!LdrShutdownThread+0x48
ntdll!RtlExitUserThread+0x3e
KERNELBASE!FreeLibraryAndExitThread+0x4a
combase!CRpcThreadCache
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForAlertByThreadId+0x14
ntdll!RtlpWaitOnAddressWithTimeout+0x81
ntdll!RtlpWaitOnAddress+0xae
ntdll!RtlpWaitOnCriticalSection+0xfd
ntdll!RtlpEnterCriticalSectionContended+0x1c4
ntdll!RtlEnterCriticalSection+0x42
msvcr110!freefls+0xde
ntdll!RtlpFlsDataCleanup+0x121
ntdll!LdrShutdownThread+0x48
ntdll!RtlExitUserThread+0x3e
ntdll!TppWorkerThread+0xc18
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForAlertByThreadId+0x14
ntdll!RtlpWaitOnAddressWithTimeout+0x81
ntdll!RtlpWaitOnAddress+0xae
ntdll!RtlpWaitOnCriticalSection+0xfd
ntdll!RtlpEnterCriticalSectionContended+0x1c4
ntdll!RtlEnterCriticalSection+0x42
msvcr110!freefls+0xde
ntdll!RtlpFlsDataCleanup+0x121
ntdll!LdrShutdownThread+0x48
ntdll!RtlExitUserThread+0x3e
ntdll!TppWorkerThread+0xc18
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForSingleObject+0x14
KERNELBASE!WaitForSingleObjectEx+0x8e
nvoglv64!DrvValidateVersion+0x7d8a
nvoglv64+0x7b299d
nvoglv64+0x7b2658
nvoglv64!DrvValidateVersion+0xa257
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForMultipleObjects+0x14
KERNELBASE!WaitForMultipleObjectsEx+0xf0
KERNELBASE!WaitForMultipleObjects+0xe
nvoglv64!DrvPresentBuffers+0x1f9f6
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForMultipleObjects+0x14
winmm!timeThread+0x91
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForSingleObject+0x14
KERNELBASE!WaitForSingleObjectEx+0x8e
tsprint!CAPCThread
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForSingleObject+0x14
KERNELBASE!WaitForSingleObjectEx+0x8e
nvoglv64!DrvValidateVersion+0x7d8a
nvoglv64!DrvPresentBuffers+0x1bfe6a
nvoglv64!DrvValidateVersion+0xa257
kernel32!BaseThreadInitThunk+0x14
ntdll!RtlUserThreadStart+0x21
Call Site
ntdll!NtWaitForAlertByThreadId+0x14
ntdll!RtlAcquireSRWLockExclusive+0x165
ntdll!RtlpCallVectoredHandlers+0x87
ntdll!RtlDispatchException+0x66
ntdll!KiUserExceptionDispatch+0x2e (TrapFrame # 0000007f`edeff3a8)
msvcr110!_addlocaleref+0x71
msvcr110!initptd+0xac
msvcr110!CrtEndBoot+0x140
ntdll!LdrpCallInitRoutine+0x61
ntdll!LdrpInitializeThread+0x167
ntdll!LdrpInitialize+0x408
ntdll!LdrpInitialize+0x3b
ntdll!LdrInitializeThunk+0xe
Call Site
ntdll!NtWaitForSingleObject+0x14
ntdll!LdrpDrainWorkQueue+0x15e
ntdll!LdrpInitializeThread+0x8b
ntdll!LdrpInitialize+0x408
ntdll!LdrpInitialize+0x3b
ntdll!LdrInitializeThunk+0xe
Call Site
ntdll!NtWaitForSingleObject+0x14
ntdll!LdrpDrainWorkQueue+0x15e
ntdll!LdrpInitializeThread+0x8b
ntdll!LdrpInitialize+0x408
ntdll!LdrpInitialize+0x3b
ntdll!LdrInitializeThunk+0xe

Unable to create Spark Context (Livy) in Knime Analytics Platform

I’m sorry if I am writing in the wrong topic, but I have the following issue:
I have created a Create Spark Context (Livy) node and I am trying to connect it to HDFS cluster managed by Cloudera.
I have made all the settings for Spark Job server and Livy URL (hope so) and when I try to execute the node, it creates a livy session (checked in YARN), it allocates the configured resources from the node, but after that I get the following error:
“ERROR Create Spark Context (Livy) 3:30 Execute failed: Broken pipe (Write failed) (SocketException)”
Here are some YARN logs:
Yarn Logs
Here are Knime Logs:
2021-12-22 18:02:49,579 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : LivySparkContext : Create Spark Context (Livy) : 3:30 : Creating new remote Spark context sparkLivy://dfe62d7e-a250-41a3-9601-1bac31379ffb at https://cm-master1-all-prod.emag.network:8998 with authentication KERBEROS.
2021-12-22 18:02:49,585 : INFO : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : SparkContext : Create Spark Context (Livy) : 3:30 : Spark context sparkLivy://dfe62d7e-a250-41a3-9601-1bac31379ffb changed status from CONFIGURED to OPEN
2021-12-22 18:03:21,097 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : LivySparkContext : Create Spark Context (Livy) : 3:30 : Uploading Kryo version detector job jar.
2021-12-22 18:03:21,801 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : LivySparkContext : Create Spark Context (Livy) : 3:30 : Running Kryo version detector job jar.
2021-12-22 18:03:22,400 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : LivySparkContext : Create Spark Context (Livy) : 3:30 : Using Kryo serializer version: kryo2
2021-12-22 18:03:22,400 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : LivySparkContext : Create Spark Context (Livy) : 3:30 : Uploading job jar: /var/folders/13/8vjx3pj137l2qrh_xwpnqwqc0000gp/T/sparkClasses16857522895332955503.jar
2021-12-22 18:03:22,423 : INFO : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : LivySparkContext : Create Spark Context (Livy) : 3:30 : Destroying Livy Spark context
2021-12-22 18:03:23,150 : INFO : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : SparkContext : Create Spark Context (Livy) : 3:30 : Spark context sparkLivy://dfe62d7e-a250-41a3-9601-1bac31379ffb changed status from OPEN to CONFIGURED
2021-12-22 18:03:23,151 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : Node : Create Spark Context (Livy) : 3:30 : reset
2021-12-22 18:03:23,151 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : SparkNodeModel : Create Spark Context (Livy) : 3:30 : In reset() of SparkNodeModel. Calling deleteSparkDataObjects.
2021-12-22 18:03:23,152 : ERROR : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : Node : Create Spark Context (Livy) : 3:30 : Execute failed: Broken pipe (Write failed) (SocketException)
java.util.concurrent.ExecutionException: java.net.SocketException: Broken pipe (Write failed)
at java.base/java.util.concurrent.FutureTask.report(Unknown Source)
at java.base/java.util.concurrent.FutureTask.get(Unknown Source)
at org.knime.bigdata.spark.core.livy.context.LivySparkContext.waitForFuture(LivySparkContext.java:492)
at org.knime.bigdata.spark.core.livy.context.LivySparkContext.uploadJobJar(LivySparkContext.java:464)
at org.knime.bigdata.spark.core.livy.context.LivySparkContext.open(LivySparkContext.java:327)
at org.knime.bigdata.spark.core.context.SparkContext.ensureOpened(SparkContext.java:145)
at org.knime.bigdata.spark.core.livy.node.create.LivySparkContextCreatorNodeModel2.executeInternal(LivySparkContextCreatorNodeModel2.java:85)
at org.knime.bigdata.spark.core.node.SparkNodeModel.execute(SparkNodeModel.java:240)
at org.knime.core.node.NodeModel.executeModel(NodeModel.java:549)
at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1267)
at org.knime.core.node.Node.execute(Node.java:1041)
at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:559)
at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95)
at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201)
at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117)
at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:365)
at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:219)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)
Caused by: java.net.SocketException: Broken pipe (Write failed)
at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
at java.base/java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.base/java.net.SocketOutputStream.write(Unknown Source)
at java.base/sun.security.ssl.SSLSocketOutputRecord.deliver(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppOutputStream.write(Unknown Source)
at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:124)
at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:136)
at org.apache.http.impl.io.SessionOutputBufferImpl.write(SessionOutputBufferImpl.java:167)
at org.apache.http.impl.io.ContentLengthOutputStream.write(ContentLengthOutputStream.java:113)
at org.apache.http.entity.mime.content.FileBody.writeTo(FileBody.java:121)
at org.apache.http.entity.mime.AbstractMultipartForm.doWriteTo(AbstractMultipartForm.java:134)
at org.apache.http.entity.mime.AbstractMultipartForm.writeTo(AbstractMultipartForm.java:157)
at org.apache.http.entity.mime.MultipartFormEntity.writeTo(MultipartFormEntity.java:113)
at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:156)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:238)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
at org.apache.livy.client.http.LivyConnection.executeRequest(LivyConnection.java:292)
at org.apache.livy.client.http.LivyConnection.access$000(LivyConnection.java:68)
at org.apache.livy.client.http.LivyConnection$3.run(LivyConnection.java:277)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.livy.client.http.LivyConnection.sendRequest(LivyConnection.java:274)
at org.apache.livy.client.http.LivyConnection.post(LivyConnection.java:228)
at org.apache.livy.client.http.HttpClient$3.call(HttpClient.java:256)
at org.apache.livy.client.http.HttpClient$3.call(HttpClient.java:253)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
2021-12-22 18:03:23,152 : DEBUG : pool-7-thread-1 : : DestroyAndDisposeSparkContextTask : : : Destroying and disposing Spark context: sparkLivy://dfe62d7e-a250-41a3-9601-1bac31379ffb
2021-12-22 18:03:23,153 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : WorkflowManager : Create Spark Context (Livy) : 3:30 : Create Spark Context (Livy) 3:30 doBeforePostExecution
2021-12-22 18:03:23,154 : INFO : pool-7-thread-1 : : LivySparkContext : : : Destroying Livy Spark context
2021-12-22 18:03:23,155 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : NodeContainer : Create Spark Context (Livy) : 3:30 : Create Spark Context (Livy) 3:30 has new state: POSTEXECUTE
2021-12-22 18:03:23,155 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : WorkflowManager : Create Spark Context (Livy) : 3:30 : Create Spark Context (Livy) 3:30 doAfterExecute - failure
2021-12-22 18:03:23,155 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : NodeContainer : Create Spark Context (Livy) : 3:30 : Parquet to Spark 3:32 has new state: CONFIGURED
2021-12-22 18:03:23,156 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : NodeContainer : Create Spark Context (Livy) : 3:30 : Spark to Parquet 3:37 has new state: IDLE
2021-12-22 18:03:23,156 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : Node : Create Spark Context (Livy) : 3:30 : reset
2021-12-22 18:03:23,156 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : SparkNodeModel : Create Spark Context (Livy) : 3:30 : In reset() of SparkNodeModel. Calling deleteSparkDataObjects.
2021-12-22 18:03:23,156 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : Node : Create Spark Context (Livy) : 3:30 : clean output ports.
2021-12-22 18:03:23,156 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : WorkflowDataRepository : Create Spark Context (Livy) : 3:30 : Removing handler 9c1d8004-908d-43fe-8347-45ba78bd7c58 (Create Spark Context (Livy) 3:30: ) - 5 remaining
2021-12-22 18:03:23,156 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : NodeContainer : Create Spark Context (Livy) : 3:30 : Create Spark Context (Livy) 3:30 has new state: IDLE
2021-12-22 18:03:23,156 : DEBUG : pool-7-thread-1 : : DestroyAndDisposeSparkContextTask : : : Destroying and disposing Spark context: sparkLivy://bf46d062-17db-4ec1-8d06-28b53da7c624
2021-12-22 18:03:23,157 : INFO : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : SparkContext : Create Spark Context (Livy) : 3:30 : Spark context sparkLivy://f5354b5c-b44d-4460-b270-17f0ea238f4b changed status from NEW to CONFIGURED
2021-12-22 18:03:23,157 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : Node : Create Spark Context (Livy) : 3:30 : Configure succeeded. (Create Spark Context (Livy))
2021-12-22 18:03:23,157 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : NodeContainer : Create Spark Context (Livy) : 3:30 : Create Spark Context (Livy) 3:30 has new state: CONFIGURED
2021-12-22 18:03:23,157 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : Node : Parquet to Spark : 3:32 : Configure succeeded. (Parquet to Spark)
2021-12-22 18:03:23,157 : DEBUG : KNIME-Worker-78-Create Spark Context (Livy) 3:30 : : NodeContainer : Create Spark Context (Livy) : 3:30 : HDFS 3 has new state: IDLE
2021-12-22 18:03:42,421 : DEBUG : main : : NodeContainerEditPart : : : Spark to Parquet 3:37 (IDLE)
2021-12-22 18:03:42,424 : DEBUG : main : : NodeContainerEditPart : : : Parquet to Spark 3:32 (CONFIGURED)
2021-12-22 18:03:44,073 : DEBUG : main : : NodeContainerEditPart : : : Parquet to Spark 3:32 (CONFIGURED)
2021-12-22 18:03:44,073 : DEBUG : main : : NodeContainerEditPart : : : Spark to Parquet 3:37 (IDLE)
2021-12-22 18:53:19,830 : INFO : main : : SparkContext : : : Spark context jobserver://cm-master3-all-prod.emag.network:8090/knimeSparkContext changed status from NEW to CONFIGURED
2021-12-22 18:53:23,611 : DEBUG : main : : NodeContainerEditPart : : : Spark to Parquet 3:37 (IDLE)
2021-12-22 18:53:23,613 : DEBUG : main : : NodeContainerEditPart : : : Create Spark Context (Livy) 3:30 (CONFIGURED)
Please let me know if any more info is needed.
Thank you in advance,
Andrei

problem with write from spark structured streaming to oracle table

I read files in a directory with readStream and process files, at the end I have a dataframe that I want to write it to oracle table. I use jdbc driver for do that and foreachbach() api.here my code:
def SaveToOracle(df,epoch_id):
try:
df.write.format('jdbc').options(
url='jdbc:oracle:thin:#192.168.49.8:1521:ORCL',
driver='oracle.jdbc.driver.OracleDriver',
dbtable='spark.result_table',
user='spark',
password='spark').mode('append').save()
pass
except Exception as e:
response = e.__str__()
print(response)
streamingQuery = (summaryDF4.writeStream
.outputMode("append")
.foreachBatch(SaveToOracle)
.start()
)
the job fail without any error and stop after start query streaming. the console log is like this:
2021-08-11 10:45:11,003 INFO cluster.YarnClientSchedulerBackend: Shutting down all executors
2021-08-11 10:45:11,003 INFO cluster.YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
2021-08-11 10:45:11,007 INFO streaming.MicroBatchExecution: Starting new streaming query.
2021-08-11 10:45:11,009 INFO cluster.YarnClientSchedulerBackend: YARN client scheduler backend Stopped
2021-08-11 10:45:11,011 INFO streaming.MicroBatchExecution: Stream started from {}
2021-08-11 10:45:11,021 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
2021-08-11 10:45:11,034 INFO memory.MemoryStore: MemoryStore cleared
2021-08-11 10:45:11,034 INFO storage.BlockManager: BlockManager stopped
2021-08-11 10:45:11,042 INFO storage.BlockManagerMaster: BlockManagerMaster stopped
2021-08-11 10:45:11,046 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
2021-08-11 10:45:11,053 INFO spark.SparkContext: Successfully stopped SparkContext
2021-08-11 10:45:11,056 INFO util.ShutdownHookManager: Shutdown hook called
2021-08-11 10:45:11,056 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-bf5c7539-9d1f-4c9d-af46-0c0874a81a40/pyspark-7416fc8a-18bd-4e79-aa0f-ea673e7c5cd8
2021-08-11 10:45:11,060 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-47c28d1d-236c-4b64-bc66-d07a918abe01
2021-08-11 10:45:11,063 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-bf5c7539-9d1f-4c9d-af46-0c0874a81a40
2021-08-11 10:45:11,065 INFO util.ShutdownHookManager: Deleting directory /tmp/temporary-f9420356-164a-4806-abb2-f132b8026b20
what is the problem and how can I get a proper log?
this is my sparkSession conf:
conf = SparkConf()
conf.set("spark.jars", "/home/hadoop/ojdbc6.jar")
spark=(SparkSession
.builder
.config(conf=conf)
.master("yarn")
.appName("Test010")
.getOrCreate()
)
Update:
I get Error on jdbc save(), here is :
An error occurred while calling o379.save.
: java.lang.ClassNotFoundException: oracle.jdbc.driver.OracleDriver
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.spark.sql.execution.datasources.jdbc.DriverRegistry$.register(DriverRegistry.scala:46)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.$anonfun$driverClass$1(JDBCOptions.scala:102)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.$anonfun$driverClass$1$adapted(JDBCOptions.scala:102)
at scala.Option.foreach(Option.scala:407)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.<init>(JDBCOptions.scala:102)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcOptionsInWrite.<init>(JDBCOptions.scala:217)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcOptionsInWrite.<init>(JDBCOptions.scala:221)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:45)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:46)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:90)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:180)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:218)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:215)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:176)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:132)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:131)
at org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:989)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:989)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:438)
at org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:415)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:301)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)

You need to call awaitTermination() method on streamingQuery after start() method call like this:
streamingQuery = (summaryDF4.writeStream
.outputMode("append")
.foreachBatch(SaveToOracle)
.start()
.awaitTermination())

thanks for your answer it keeps streaming job alive but still it doesn't work
"id" : "3dc2a37f-4a7a-49b9-aa83-bff526aa14c5",
"runId" : "e8864901-2729-41c5-b7e4-a19ac2478f1c",
"name" : null,
"timestamp" : "2021-08-11T06:51:00.000Z",
"batchId" : 2,
"numInputRows" : 0,
"inputRowsPerSecond" : 0.0,
"processedRowsPerSecond" : 0.0,
"durationMs" : {
"addBatch" : 240,
"getBatch" : 66,
"latestOffset" : 21,
"queryPlanning" : 143,
"triggerExecution" : 514,
"walCommit" : 23
},
"eventTime" : {
"watermark" : "1970-01-01T00:00:00.000Z"
},
"stateOperators" : [ {
"numRowsTotal" : 0,
"numRowsUpdated" : 0,
"memoryUsedBytes" : -1,
"numRowsDroppedByWatermark" : 0,
"customMetrics" : {
"loadedMapCacheHitCount" : 0,
"loadedMapCacheMissCount" : 0,
"stateOnCurrentVersionSizeBytes" : -1
}
} ],
"sources" : [ {
"description" : "FileStreamSource[hdfs://192.168.49.13:9000/input/lz]",
"startOffset" : {
"logOffset" : 1
},
"endOffset" : {
"logOffset" : 2
},
"numInputRows" : 0,
"inputRowsPerSecond" : 0.0,
"processedRowsPerSecond" : 0.0
} ],
"sink" : {
"description" : "ForeachBatchSink",
"numOutputRows" : -1
}
}
if I use console my process doesn't have any problem and it will be correct but for write to oracle I have problem.

Powershell Set-AzDataLakeStoreItemAclEntry Error occured while sending the request

Trying to execute the following command in Powershell ISE
Set-AzDataLakeStoreItemAclEntry -Account "********" -Path "/raw2" -AceType Group -Id "******************" -Permissions All
I only have the Az module installed, no Rm
But I get the following error, any suggestions?
Set-AzDataLakeStoreItemAclEntry : Error in modifying ACL entries group:************:rwx for path /raw2.
Operation: MODIFYACLENTRIES failed with Unknown Error: An error occurred while sending the request. Source: mscorlib StackTrace: at
System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.DataLake.Store.WebTransport.<MakeSingleCallAsync>d__20.MoveNext().
.
Last encountered exception thrown after 5 tries. [An error occurred while sending the request.,An error occurred while sending the request.,An error occurred while sending the request.,An
error occurred while sending the request.,An error occurred while sending the request.]
[ServerRequestId:]
At line:1 char:1
+ Set-AzDataLakeStoreItemAclEntry -Account "**********" -Path "/raw2 ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : CloseError: (:) [Set-AzDataLakeStoreItemAclEntry], AdlsException
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.DataLakeStore.SetAzureDataLakeStoreItemAclEntry

Error while executing Start-AzureSqlDatabaseImport

We get the following error while executing Start-AzureSqlDatabaseImport.SQL server firewall rule is configured properly.Container is with Public access.
Error is thrown at this line: Start-AzureSqlDatabaseImport -SqlConnectionContext $SqlCtx -StorageContainer $Container -DatabaseName $DbName -BlobName $BlobName -ErrorAction Stop
Start-AzureSqlDatabaseImport : An error occurred while making the HTTP request to https://management.core.windows.net/subscriptionid/services/sqlservers/servers/sqlservername/DacOperations/Import. This could be due to the fact that the server
certificate is not configured properly with HTTP.SYS in the HTTPS case. This could also be caused by a mismatch of the security
binding between the client and the server.
At C:\Azure\PowerShellScripts\ImportDB.ps1:13 char:1
+ Start-AzureSqlDatabaseImport -SqlConnectionContext $SqlCtx -StorageContainer $Co ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [Start-AzureSqlDatabaseImport], CommunicationException
+ FullyQualifiedErrorId : Microsoft.WindowsAzure.Management.SqlDatabase.Database.Cmdlet.StartAzureSqlDatabaseImport

Resources