![]() So you get the easy rapid prototyping with python CLI, but calling a much more powerful C++ in the background. The python wrapper is using C++ library in the background so it is not such a bad performance as you would expect if this was all vanilla python. Investigation of basic “of the shelf” computer vision capabilitiesĪs stated before, I wanted to learn CV (computer vision), and after some research I gravited to OpenCV ( ) and because I am lazy when prototyping, to the python wrapper around it ( OpenCV-python-Tutorials-page). Meaning no classification presented here will work 100% and that is why creating a playing bot is also going to have a statistical results. So despite all this, there is “something” possible and we will investigate this together below, just keep in mind all that we do here has a “Statistical” success rate. Elite’s GUI transparency problem demonstrated in top-left corner Example below, in that situation nothing can read the top-left panel, not even humans. the navigation target pointer appearing behind a sun, or even cockpit reflections when you are close to a sun literally destroy some classification algorithms (Keypoint family) ability to locate that instrument on the screen. F29 Retaliator GUI (1991)Īnd even worse the Elite’s instruments are partly transparent, which makes it super hard for even the more advanced algorithms to work with because they can be literally blinded by in-game objects. Nothing like Elite has or what you as human experiences when driving a car. Have a look below on the difference between old 1991 game called “F29 Retaliator”, that GUI is simple to find and analyze, worst case you can write per-pixel classification for that. not simply reading the specific instrument, but actually finding that instrument in real time in some 3D space and adjust the reading of that instrument via 3D perspective transformations. Comparing that to a flat 2D GUI, like some old games had, this introduces challenges that I wanted to focus one. This makes it a good experiments platform for trying to create for example algorithmes that a physical humanoid robot would face trying to drive a car. Simple, combination of two things, first I like this game and I am familiar with it and secondly this is a game that has a 3D rendered perspective GUI that shifts position, size and rotation during a flight via simulated inertial forces. II.II – An example run of my simple Elite autopilot.II.I – State machine, or “insert real AI here later”.Creating a long-distance jumping and cruising autopilot Live tracking after object already identified in previous frames Investigation of basic “of the shelf” computer vision capabilities So now that this is said, lets look at the interesting challenges of using computer vision (provided by OpenCV library) to analyze flight in Elite Dangerous. But it is your responsibility and try to think hard if your are not destroying the very game you like (but you might learn some skills for your carrier in the process). If you are here to learn how to program a cheat for yourself then kudos to you as I am trying to elaborate in the conclusion parts below, this is not really preventable. If you are here looking for a game cheat, you will not get it. If I do not figure out some clever way how to share this without some script-kiddies turning this experiment into a cheat I never will share this code. That is also the reason why code of my experiments is not disclosed. looking at monitor and pushing keyboard) that no anti-cheat will ever catch, but that is way beyond my motivation as I personally like Elite as it is and definitely do not want to destroy its internal mechanics by creating a farming/trading bot this way. This was never intended as a game cheat/bot or anything like that, although in the last chapter I will give my thoughts on AI becoming a thing playing games using undetectable external “human loops” (e.g. This is an educational project for me learning some computer vision algorithms (I want to make an insect identification system to protect a bee hive, – but that is for much later article) and the game Elite Dangerous provided only interesting guinea pig here to test some principles.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |