Robot
is used for simulating user interaction such as
typing keys on the keyboard and using the mouse as well as capturing
graphical information without requiring a Scene
instance. Robot objects must be constructed and used on the JavaFX
Application Thread.- Since:
- 11
-
Constructor Summary
ConstructorDescriptionRobot()
Constructs a newRobot
that can be used for simulating user interactions. -
Method Summary
Modifier and TypeMethodDescriptionReturns the current mouse (x,y) screen coordinates as aPoint2D
.double
Returns the current mousex
position in screen coordinates.double
Returns the current mousey
position in screen coordinates.getPixelColor
(double x, double y) Returns theColor
of the pixel at the screen coordinates relative to the primary screen specified bylocation
.getPixelColor
(Point2D location) Returns theColor
of the pixel at the screen coordinates relative to the primary screen specified bylocation
.getScreenCapture
(WritableImage image, double x, double y, double width, double height) Returns aWritableImage
containing the specified rectangular area relative to the primary screen.getScreenCapture
(WritableImage image, double x, double y, double width, double height, boolean scaleToFit) Returns aWritableImage
containing the specified rectangular area relative to the primary screen.getScreenCapture
(WritableImage image, Rectangle2D region) Returns aWritableImage
containing the specified rectangular area relative to the primary screen.getScreenCapture
(WritableImage image, Rectangle2D region, boolean scaleToFit) Returns aWritableImage
containing the specified rectangular area relative to the primary screen.void
Presses the specifiedKeyCode
key.void
keyRelease
(KeyCode keyCode) Releases the specifiedKeyCode
key.void
Types the specifiedKeyCode
key.void
mouseClick
(MouseButton... buttons) Clicks the specifiedMouseButton
s.void
mouseMove
(double x, double y) Moves the mouse to the specified (x,y) screen coordinates relative to the primary screen.final void
Moves the mouse to the (x,y) screen coordinates, relative to the primary screen, specified by the givenlocation
.void
mousePress
(MouseButton... buttons) Presses the specifiedMouseButton
s.void
mouseRelease
(MouseButton... buttons) Releases the specifiedMouseButton
s.void
mouseWheel
(int wheelAmt) Scrolls the mouse wheel by the specified amount of wheel clicks.
-
Constructor Details
-
Robot
public Robot()Constructs a newRobot
that can be used for simulating user interactions. If a security manager is present, the application must have theFXPermission
"createRobot"
permission in order to construct aRobot
object.- Throws:
IllegalStateException
- if this object is constructed on a thread other than the JavaFX Application Thread.SecurityException
- if a security manager exists and the application does not have theFXPermission
"createRobot"
permission.
-
-
Method Details
-
keyPress
Presses the specifiedKeyCode
key.- Parameters:
keyCode
- the key to press- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if keyCode is null.
-
keyRelease
Releases the specifiedKeyCode
key.- Parameters:
keyCode
- the key to release- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if keyCode is null.
-
keyType
Types the specifiedKeyCode
key.- Implementation Requirements:
- This is a convenience method that is equivalent to calling
keyPress(KeyCode)
followed bykeyRelease(KeyCode)
. - Parameters:
keyCode
- the key to type- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if keyCode is null.
-
getMouseX
public double getMouseX()Returns the current mousex
position in screen coordinates.- Returns:
- the current mouse
x
position - Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getMouseY
public double getMouseY()Returns the current mousey
position in screen coordinates.- Returns:
- the current mouse
y
position - Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getMousePosition
Returns the current mouse (x,y) screen coordinates as aPoint2D
.- Returns:
- the current mouse (x,y) screen coordinates
- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
mouseMove
public void mouseMove(double x, double y) Moves the mouse to the specified (x,y) screen coordinates relative to the primary screen.- Parameters:
x
- screen coordinate x to move the mouse toy
- screen coordinate y to move the mouse to- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
mouseMove
Moves the mouse to the (x,y) screen coordinates, relative to the primary screen, specified by the givenlocation
.- Parameters:
location
- the (x,y) coordinates to move the mouse to- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if location is null.
-
mousePress
Presses the specifiedMouseButton
s.- Parameters:
buttons
- the mouse buttons to press- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if buttons is null.
-
mouseRelease
Releases the specifiedMouseButton
s.- Parameters:
buttons
- the mouse buttons to release- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if buttons is null.
-
mouseClick
Clicks the specifiedMouseButton
s.- Implementation Requirements:
- This is a convenience method that is equivalent to calling
mousePress(MouseButton...)
followed bymouseRelease(MouseButton...)
. - Parameters:
buttons
- the mouse buttons to click- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if buttons is null.
-
mouseWheel
public void mouseWheel(int wheelAmt) Scrolls the mouse wheel by the specified amount of wheel clicks. A positivewheelAmt
scrolls the wheel towards the user (down) whereas negative amounts scrolls the wheel away from the user (up).- Parameters:
wheelAmt
- the (signed) amount of clicks to scroll the wheel- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getPixelColor
Returns theColor
of the pixel at the screen coordinates relative to the primary screen specified bylocation
. Regardless of the scale of the screen (Screen.getOutputScaleX()
,Screen.getOutputScaleY()
), this method only samples a single pixel. For example, on a HiDPI screen with output scale 2, the screen unit at the point (x,y) may have 4 pixels. In this case the color returned is the color of the top, left pixel. Color values are not averaged when a screen unit is made up of more than one pixel.- Parameters:
x
- the x coordinate to get the pixel color fromy
- the y coordinate to get the pixel color from- Returns:
- the pixel color at the specified screen coordinates
- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getPixelColor
Returns theColor
of the pixel at the screen coordinates relative to the primary screen specified bylocation
. Regardless of the scale of the screen (Screen.getOutputScaleX()
,Screen.getOutputScaleY()
), this method only samples a single pixel. For example, on a HiDPI screen with output scale 2, the screen unit at the point (x,y) may have 4 pixels. In this case the color returned is the color of the top, left pixel. Color values are not averaged when a screen unit is made up of more than one pixel.- Parameters:
location
- the (x,y) coordinates to get the pixel color from- Returns:
- the pixel color at the specified screen coordinates
- Throws:
NullPointerException
- if the givenlocation
is nullIllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getScreenCapture
public WritableImage getScreenCapture(WritableImage image, double x, double y, double width, double height, boolean scaleToFit) Returns aWritableImage
containing the specified rectangular area relative to the primary screen. If the givenimage
is null, or if the givenimage
is not the required size, a newWritableImage
will be created and returned. Otherwise, the givenimage
is re-used.If the
scaleToFit
argument is false, the returnedImage
object dimensions may differ from the requestedwidth
andheight
depending on how many physical pixels the area occupies on the screen. For example, in HiDPI mode on the Mac (aka Retina display) the pixels are doubled, and thus a screen capture of an area of size (10x10) pixels will result in anImage
with dimensions (20x20). Calling code should use the returned images'sImage.getWidth()
andImage.getHeight()
methods to determine the actual image size.If
scaleToFit
is true, the returnedImage
is of the requested size. Note that in this case the image will be scaled in order to fit to the requested dimensions if necessary, such as when running on a HiDPI display.- Parameters:
image
- either null or aWritableImage
that will be used to place the screen capture inx
- the starting x-position of the rectangular area to capturey
- the starting y-position of the rectangular area to capturewidth
- the width of the rectangular area to captureheight
- the height of the rectangular area to capturescaleToFit
- If true, the returnedImage
will be scaled to fit the request dimensions (if necessary). Otherwise, the size of the returned image will depend on the output scale (DPI) of the primary screen.- Returns:
- the screen capture of the specified
region
as aWritableImage
- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getScreenCapture
public WritableImage getScreenCapture(WritableImage image, double x, double y, double width, double height) Returns aWritableImage
containing the specified rectangular area relative to the primary screen. If the givenimage
is null, or if the givenimage
is not the required size, a newWritableImage
will be created and returned. Otherwise, the givenimage
is re-used.- Implementation Requirements:
- This method is equivalent to calling
getScreenCapture(x, y, width, height, true)
, that is, this method scales the image to fit the requested size. - Parameters:
image
- either null or aWritableImage
that will be used to place the screen capture inx
- the starting x-position of the rectangular area to capturey
- the starting y-position of the rectangular area to capturewidth
- the width of the rectangular area to captureheight
- the height of the rectangular area to capture- Returns:
- the screen capture of the specified
region
as aWritableImage
- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.
-
getScreenCapture
Returns aWritableImage
containing the specified rectangular area relative to the primary screen. If the givenimage
is null, or if the givenimage
is not the required size, a newWritableImage
will be created and returned. Otherwise, the givenimage
is re-used.- Implementation Requirements:
- This method is equivalent to calling
getScreenCapture(image, region, true)
, that is, this method scales the image to fit the requested size. - Parameters:
image
- either null or aWritableImage
that will be used to place the screen capture inregion
- the rectangular area of the screen to capture- Returns:
- the screen capture of the specified
region
as aWritableImage
- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if region is null.
-
getScreenCapture
Returns aWritableImage
containing the specified rectangular area relative to the primary screen. If the givenimage
is null, or if the givenimage
is not the required size, a newWritableImage
will be created and returned. Otherwise, the givenimage
is re-used.If the
scaleToFit
argument is false, the returnedImage
object dimensions may differ from the requestedwidth
andheight
depending on how many physical pixels the area occupies on the screen. For example, in HiDPI mode on the Mac (aka Retina display) the pixels are doubled, and thus a screen capture of an area of size (10x10) pixels will result in anImage
with dimensions (20x20). Calling code should use the returned images'sImage.getWidth()
andImage.getHeight()
methods to determine the actual image size.If
scaleToFit
is true, the returnedImage
is of the requested size. Note that in this case the image will be scaled in order to fit to the requested dimensions if necessary, such as when running on a HiDPI display.- Parameters:
image
- either null or aWritableImage
that will be used to place the screen capture inregion
- the rectangular area of the screen to capturescaleToFit
- if true, the returnedImage
will be scaled to fit the request dimensions (if necessary). Otherwise, the size of the returned image will depend on the output scale (DPI) of the primary screen.- Returns:
- the screen capture of the specified
region
as aWritableImage
- Throws:
IllegalStateException
- if this method is called on a thread other than the JavaFX Application Thread.NullPointerException
- if region is null.
-