I am trying to automate certain things in a remote desktop using surface migration techniques in blueprism.
I have to open Windows Remote Desktop and enter the login details, but i am unable to identify it in application modeller. After launching mstsc.exe using the application modeler the identify button disappears and turns back to launch and due to this i am unable to use region mode to identify or spy elements.
Any solutions for this?
Snippet of the application modeller
I solved this problem creating 2 objects.
- Object one will execute "mstsc.exe"
- Object two will attach an existing mstsc.exe execution
So you have to launch mstsc.exe in your first object then go to the second one and attach it. If everything goes fine, you'll be able to use the application modeler in your second object and identify whatever you need to.
Example first object:
1
Example second object:
2
Related
I am automating the hololense application using perception simulation. In one of the scenario, I need to perform click action on the specific objects based on the name.So, Is it possible to read the text of the selected objects ? (Note: I have selected the objects using right hand /light hand move and object is selected with distinguished color )
It seems that you want to build test automation for your app or file explorer base on the Hololens2 emulator. And what your requirement is making it automatically tap an object with a matching name in the emulator.
If so, the emulator does not support the feature which recognizing text or direct returning data from the application memory. However, you can provide more information about your business request and submit a feature request via feedback hub on new feature request to be considered in future releases of HoloLens2 emulator.
For how to post feedback request, you can follow this doc: Send feedback to Microsoft with the Feedback Hub app.
Out of the field of HoloLens app development, you can code your own desktop program to capture the view in the emulator window, and then use OCR technology to recognize the character in the screen. Finally, customize your input to the simulator according to the result. However, this is not a simple way.
I am trying to spy a pop-up. But I couldn't recognize any element using any spy mode(Even I tried region mode)on the pop-up. It was throwing an error "Can't perform any spying operation". When I inspect the popup it was created using JQuery Event Handlers. Does anyone know how to solve the spying operation?
There are two reasons why this might be occurring:
Your system's OLEACC.DLL file is not properly registered - More information is available here on how to resolve this, but the solution boils down to the following:
Open a Command Prompt (CMD.EXE) with Administrator privileges
Navigate within that to the location of your OLEACC.DLL file (usually 'C:\Windows\System32' directory)
Run the following command to re-register the DLL file:
regsvr32 OLEACC.DLL
The window is created in the window hierarchy in such a way that it technically doesn't reside within the application you're attached to - Popups generated by certain web applications are not spyable using HTML mode. Instead, you'll have to create an entirely new object with new attaching logic to be able to spy this particular window. More information on this issue is available at the following resources:
Blue Prism Knowledge Base Article - 'The window spied was not found in the model' error when spying
Blue Prism Browser Automation Guide
I've been working whit Blue Prism on a project that was using at one point IBM mainframe application(ICBS). I've mange to get it working, but only problem that I had was Login in to therminal.
My robot lunched application as mainframe app, but after that therminal is asking me to login in, but its doing that in standard Win window - whit option to enter login and password.
Problem is that Blue Prism is not able to spy on thoes elements because it's launched as mainframe.
If I launch this app as standard win application, then there is no problem in login in, but after that working whit mainframe screen is imposible because I can't spy on specyfic elements of the green screens.
I was trying to launched as mainframe, then using another object(Win app) to logon and then go back to mainframe but I cant to Attach Win app Object to allready launched mainframe object. I get "could not be found" error when I'm tring to Attach.
Any idea how to get it working?
Cheers,
RAFEL
Well, there's no other way than having two different objects.
The first one should be the "Mainframe Application" object that is launching from executable file.
The second one should be the "Windows Applications" object that is attaching to appearing window.
I am guessing that you're having a problem with attaching the second object to the window.
The Blue Prism when trying to attach to the object is checking two things:
The name of the process - you can find that information using task manager.
The window title of the target Application - that's the title that is visible at the top of the window.
There is possibility to use *,# and others as wildcard characters.
You'll have to try there around there to get that working.
Below you can find a print screen of one of mine objects that attaches to windows photo viewer.
I am getting "Not Connected" issue while executing a blue prism object. Currently, I'm working for browser application and I have given browser URL and window title in application modeler.
If I launch the application by navigation stage it's working fine but I'm expecting like already running browser we need to attach and has to do some automation operations on it.
We tried with navigation stage with actions attach/Active application, getting issue "Not connected".
Can anyone help on this issue?
Blue Prism best practice is to call “Attach” page at the beginning of each action to make sure that BP is connected to the application. This page should look like this:
Start
Read stage – to check connection status (it will return Flag with connection status)
Decision stage – connection flag
If connected – go to End
If not connected – Navigation stage – Attach
You also need to provide proper input parameters for Attach action, for Browser automation (Internet Explorer) you need to provide at least process name: “iexplore” & child index: 0 (it depends on your TabProcGrowth registry settings).
Blue Prism also recommends to start browser apps using Utility – Environment VBO & Start Process action. There are 2 inputs: Application – Path to internet explorer exe file & Arguments – webpage address.
If you want to learn more about Browser Automations in Blue Prism I recommend you to familiarize with Blue Prism Guides available on Blue Prism Portal - https://portal.blueprism.com/.
Do you have Attach bookmark created? When you are working with object you are creating bookmarks resposible for different things in your obcject(login, start etc) you need to create Attach bookmark.
I never had any problems with attaching to app, except mainframe app.
Copy your Navigate step from Launch bookmark, then create new one(call it attach) and paste that Navigate step. Then Edit it, Chane from launch to attach and in Properties you need to fill "Window Title" and "Process Title". Window title, you have it at the top window bar. Process title, youll find it in Windows Task Menager - Processes.
Hope it helps!
Well, I am not sure exactly sure if this is your problem but let me try as my issue is close to your issue.
I had encountered this: There is no current stage
So what I did was to trigger the reset button in the upper left corner of the Process Studio. Screenshot below.
Then it works like a charm!
This is because the launched instance of the application is different from the one BP is searching for. To solve this issue close the current instance of the app and Launch it from the Application Modeller.
I need to record the RDP connection from local machine thru coded ui testing framework (Visual Studio - coded ui project).
FYI. I have Coded UI test project in my local machine and as soon as i start recording I'm going to click on Remote desktop connection and it needs to be recorded.
I've played once with such a thing. Coded UI does not support RDP. There's no known way I've heard that you can just record actions inside of remote desktop.
If you really need to do something with Remote Desktop, you may try using OpenCv Library to visually identify screen coordinates of your controls. I've done it once. The algorithm is:
make a screenshot of UI control you want to click on;
save it inside your Coded UI project;
pass the image to the OpenCV library when the control is present on screen;
OpenCV returns you coordinates' rectangle of the control;
Perform Mouse.Click(); inside the rectangle.
If you are ready to go with such a solution and need more information, please let me know...