Odtnhj

I am rendering a Scene2d UI table on the 3D world using SpriteBatch, projection matrix and PerspectiveCamera

public void render (float delta) 
 spriteBatch.setProjectionMatrix(projectionMatrix.set(camera.combined).mul(transform));
 spriteBatch.begin();
 rootTable.draw(spriteBatch, 1.0f);
 spriteBatch.end();

The mouse pointer is hidden and locked to the centre of the screen. When a touchUp event is fired, if the mouse is inside the bounding box of the table, I want to calculate the Vector2 position where the mouse was actually clicked inside the table, so I can call the Table.hit function to get the clicked Actor. Also is this the right approach to draw 2D menu on the 3D world.

I am using this code to do a Ray intersection test.

Ray ray = camera.getPickRay(screenX, screenY);
int result = -1;
float distance = -1;

transform.getTranslation(position);

if (Intersector.intersectRayBoundsFast(ray, position, new Vector3(40, 40, 20) )) 
 Gdx.app.log("RAY", "Table Clicked");

The Scene2d coordinates start from the bottom left corner and in 3D they start from the centre. I used new Vector3(40, 40, 20) as dummy bounds.