Processing

Please wait...

Settings

Settings

Goto Application

1. WO2020142654 - DETECTING PASTE AND OTHER TYPES OF USER ACTIVITIES IN COMPUTER ENVIRONMENT

Note: Text based on automatic Optical Character Recognition processes. Please use the PDF version for legal matters

[ EN ]

What is claimed is:

1. A computer-based method comprising:

receiving an indication from a computer’s operating system that a user has performed a first action that may have caused a context menu with a paste option to open on a screen of the computer;

subsequently receiving an indication from the computer’s operating system that the user has performed a second action at the computer that may have amounted to a selection of the paste option on the context menu; and

in response to the indication from the computer’s operating system that the user has performed the second action, determining if the second action by the user amounted to a selection of the paste option on the context menu and thereby cause a paste action to occur.

2. The computer-based method of claim 1, further comprising:

creating a notification of the paste action in response to determining that the second action by the user caused the paste action to occur.

3. The computer-based method of claim 1, wherein the first action at the computer is a right mouse click or some other mouse click that the computer responds to by opening the context menu.

4. The computer-based method of claim 1, further comprising:

requesting information about an open context menu from an accessibility application programming interface (API) on the computer after receiving the indication from the computer’s operating system that the user has performed the first action; and

receiving information about an open context menu on the computer from the accessibility API.

5. The computer-based method of claim 4, wherein the information about the open context menu includes information about whether the open context menu has a paste option.

6. The computer-based method of claim 4, further comprising:

obtaining a handle for an in-focus window at the computer from a user interface at the computer before requesting information about the open context menu from the accessibility API, wherein the in-focus window at the computer is the open context menu.

7. The computer-based method of claim 6, wherein the request for information about the open context menu includes the handle for the in-focus window.

8. The computer-based process of claim 4, wherein the information about the open context menu from the accessibility API includes information that defines an on-screen boundary for a paste option on the open context menu.

9. The computer-based method of claim 8, wherein the second action that the user has performed at the computer is a left mouse click or some other mouse click that will select an option on the context menu if an on-screen pointer or mouse cursor is positioned within an on screen boundary for that option at the time of the click.

10. The computer-based method of claim 9, wherein the indication from the computer’s operating system that the user has performed the second action at the computer comprises information about the on-screen mouse cursor’s position at the time of the click.

11. The computer-based method of claim 10, wherein determining if the second user action amounted to a selection of the paste option on the context menu comprises:

comparing the information about the on-screen mouse cursor’s position at the time of the click to on-screen boundary for a paste option on the open context menu.

12. The computer-based method of claim 11, further comprising:

concluding that the second user action amounted to a selection of the paste option on the context menu if the on-screen mouse cursor’s position at the time of the click was within the on screen boundary for the paste option on the open context menu.

13. The computer-based method of claim 12, further comprising, after concluding that the second user action amounted to a selection of the paste option on the context menu:

collecting data from the clipboard at the computer; and

including the data collected from the clipboard with a notification of the paste action.

14. The computer-based method of claim 12, further comprising, after concluding that the second user action amounted to a selection of the paste option on the context menu:

collecting information about a user session that included the paste action; and/or collecting information about a process or application in which the paste action occurred; and

including the information about the user session and/or the information about the process of application with a notification of the paste action.

15. The computer-based method of claim 12, further comprising, after concluding that the second user action amounted to a selection of the paste option on the context menu:

causing the computer to capture a screenshot; and

including the screenshot with the notification.

16. The computer-based method of claim 1, further comprising:

sending the notification from a computer-based agent on the computer over a network connection to a monitor server.

17. A computer-based method comprising:

receiving an indication from a computer’s operating system that a user has performed a keyboard action at a computer that included one or more key presses on a keyboard that caused the computer to perform a keyboard-initiated paste action;

comparing the one or more key presses against a list of key presses and/or key press combinations, stored in a computer-based data store, that, if pressed, would cause the computer to perform the keyboard-initiated paste action;

if the one or more keys pressed match an entry in the list of key presses and/or key press combinations, then concluding that the keyboard action by the user caused the keyboard-initiated paste action to occur; and

creating a notification of the keyboard-initiated paste action.

18. A computer system comprising:

a monitor application server; and

a computer connected to the monitor application server via a network connection, wherein the computer comprises: a keyboard, a computer mouse, a screen, an operating system, and a computer-based agent,

wherein the computer-based agent is configured to:

receive an indication from the operating system that a user has performed a first action with the mouse that may have caused a context menu with a paste option to open on the screen, wherein the first action with the mouse is a right mouse click or some other mouse click that the computer responds to by opening the context menu; subsequently receive an indication from the operating system that the user has performed a second action with the mouse that may have amounted to a selection of the paste option on the context menu, wherein the second action with the mouse is a left mouse click or some other mouse click that will select an option on the context menu if an on-screen pointer or mouse cursor is positioned within an on-screen boundary for that option at the time of the click; and

in response to the indication from the computer’s operating system that the user has performed the second action with the mouse, determine if the second action with the mouse amounted to an actual selection of the paste option on the context menu and thereby cause a paste action to occur.

19. The computer system of claim 18, wherein the computer-based agent is configured to: create a notification of the paste action after determining that the second action by the user caused the paste action to occur.

20. The computer system of claim 18, wherein the computer-based agent is configured to: obtain a handle for an in-focus window at the computer from the user interface;

request information about an open context menu from an accessibility application programming interface (API) on the computer, where the request to the accessibility API includes the handle for the in-focus window; and

receive information about the open context menu from the accessibility API on the computer.

21. The computer system of claim 20, wherein the information about the open context menu includes information about whether the open context menu has a paste option.

22. The computer system of claim 21, wherein the information about the open context menu defines an on-screen boundary for a paste option on the open context menu.

23. The computer system of claim 22, wherein the indication from the computer’s operating system that the user has performed the second action with the mouse includes information about the on-screen pointer or mouse cursor’s position at the time of the click, and wherein the computer-based agent determines if the second user action amounted to a selection of the paste option on the context menu by a process that comprises:

comparing the information about the on-screen mouse cursor’s position at the time of the click to on-screen boundary for a paste option on the open context menu; and

concluding that the second user action amounted to a selection of the paste option on the context menu if the on-screen mouse cursor’s position at the time of the click was within the on screen boundary for the paste option on the open context menu.

24. A computer-based method for determining whether a user at a computer has used a mouse to select a particular option from an on-screen context menu, the method comprising: obtaining a handle for an in-focus window at the computer from a user interface of the computer; and

using the handle to request information about an on-screen context menu from an accessibility application programming interface (API) on the computer,

wherein the on-screen context menu is the in-focus window.

25. The computer-based method of claim 24, further comprising, in response to the request for information:

receiving information about the open context menu on the computer from the

accessibility API.

26. The computer-based method of claim 24, wherein the information identifies that the particular option is available on the on-screen menu.

27. The computer-based method of claim 26, wherein the particular option is a paste option.

28. The computer-based method of claim 26, further comprising:

wherein the information defines an on-screen boundary for the particular option on the on-screen context menu.

29. The computer-based method of claim 28, further comprising:

receiving an indication from the computer’s operating system that the user has performed a first action with the mouse that may have caused the context menu to open on the screen; and subsequently receiving an indication from the computer’s operating system that the user has performed a second action with the mouse that may have amounted to a selection of the particular option on the context menu if an on-screen pointer or mouse cursor was positioned within an on-screen boundary for the particular option at the time of the second action.

30. The computer-based method of claim 28, wherein the indication from the computer’s operating system that the user has performed a second action with the mouse includes

information about the on-screen pointer or mouse cursor’s position at the time of the second action.

31. The computer-based method of claim 30, further comprising:

determining if the second user action amounted to a selection of the particular option on the context menu by a process that comprises:

comparing the information about the on-screen mouse cursor’s position at the time of the second action to the on-screen boundary for the particular option on the open context menu; and concluding that the second user action amounted to a selection of the particular option on the context menu if the on-screen mouse cursor’s position at the time of the click was within the on-screen boundary for the particular option on the open context menu.

32. The computer-based method of claim 31, further comprising:

creating a notification that the particular option action in response to determining that the second action by the user amounted to a selection of the particular option on the context menu.