Odtnhj

I am trying to log into investing.com to go to my portfolio so I can get the current information on the page.
I am having an issue with the Login because it is not on the main page, but a popup page called "loginPopupform"

Here is my code that I have tried.

String baseUrl = "https://www.investing.com"; 
String sChartLink = "https://www.investing.com/portfolio";
String strLogin = "username";
String strPassword = "password" ;
String ua = ""Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/25.0"";
Response res = null;
Document docRes = null; 
res = Jsoup
 .connect(baseUrl)
 .timeout(30000)
 .method(Connection.Method.POST)
 .data("loginFormUser_email", strLogin, "loginForm_password", strPassword)
 .userAgent(ua)
 .execute(); 
docRes = res.parse();
Map<String, String> cookies = res.cookies();
doc1 = Jsoup.connect(sChartLink).userAgent(ua).cookies(cookies).get();
sDate = doc1.select("input[id="curDate"]").text();

The sDate is empty and when I look into the doc1, there isn't any information that is in my profile.

To make that you need to force the JS of the website because the pop-up modal is not static content so Jsoup does not retrieve it. So you need to use Selenium to force the JS and retrieve the dynamic content.

If it's a pop-up modal I guess you need to click on a button to load it, the way to do that using Selenium for Java is as it follows:

WebDriver webDriver = new FirefoxDriver();
JavascriptExecutor js = (JavascriptExecutor)webDriver;

webDriver.get(URL);

WebDriverWait webDriverWait = new WebDriverWait(webDriver, 15); // wait 15 seconds

WebElement button = webDriver.findElement(By.id("id of the button that triggers the modal"));
js.executeScript("arguments[0].click();", button);

webDriverWait.until(ExpectedConditions.visibilityOfElementLocated(By.name("loginPopupform")));

String fullHtml = webDriver.getPageSource();

Hope it helped you! Feel free to ask me anything else!