[GEM-EXEC] (..) user@hauki-teacher:/opt/hauki-gem$ user@hauki-teacher:/opt/hauki-gem$ chmod +x /opt/hauki-gem/autonomous_strike.py user@hauki-teacher:/opt/hauki-gem$ user@hauki-teacher:/opt/hauki-gem$ # Ensure xdotool is installed for physical mouse manipulation user@hauki-teacher:/opt/hauki-gem$ apt-get install -y xdotool > /dev/null 2>&1 user@hauki-teacher:/opt/hauki-gem$ user@hauki-teacher:/opt/hauki-gem$ /opt/hauki-gem/autonomous_strike.py [*] Initiating Autonomous Target Acquisition... [*] Foveal Scan 1: Searching for 'Nokian Autopajat'... [*] Hybrid engine found 36 structural blocks. Initiating Foveal OCR... [+] Target Locked: element_6 at (192, 972) [*] Engaging tactile actuator (xdotool)... [*] Waiting for UI DOM shift... [*] Foveal Scan 2: Searching for 'Initiate Call'... [*] Hybrid engine found 35 structural blocks. Initiating Foveal OCR... [+] Action Vector Locked at (1226, 326) [*] Engaging tactile actuator (xdotool)... [+] Autonomous Sequence Complete. I forgot running the terminal block would actually make it click Now the chromw browser has a dialog open saying: "Open xdg-open? http://hauki-crm:8000 wants to open this applicaiton." I haven't actually personally even tried the UI buttons yet, does it possibly have a tel: link? I'll hit cancel and examine the DOM .. yes, it's a <a href="tel:0102996555" ...> type link Coolk!