The challenge begins. The first puzzle was quite easy to solve, but posed some challenges to write an efficient prompt.
Reminder: my challenge is to attempt to solve the problem without writing a single line of code. Ideally, just writing an initial prompt and get the whole code in one go.
You can see the full source code (and the respective prompts) in my repository at https://github.com/nunodonato/advent-of-code-2021
Although the problem was fairly simple, Copilot struggled with a very specific part of it.
First, I was impressed how easy it was to get it to read from a file which name I didn’t specify directly. I wanted each day to have it’s own input in an “inputs” folder, and have the filenames match. This was easy to accomplish and the solution presented was spot on!
The next part involved a lot of trial and error with the right prompt phrasing. Interestingly the problems with the generated code was always EITHER:
looping the array in such a way the it would go out of bounds (trying to read the next position when already in the last, for example) – although this was ok as PHP doesn’t crash, I didn’t accept the solution
not incrementing the counter for every find, but instead adding the value of the line to the counter
I had to tinker with this particular line of the prompt until I managed to get it right. And even that was not perfect as the first solution proposed was incorrect. The second, however, was flawless
After I got the problem solved and the solution accepted, I copy&pasted my prompt into OpenAI’s playground using the davinci-codex model.
The solution presented was quite different from what I got, and it was wrong.
I tried a few more, while changing the temperature value, and got a very similar solution(but still not correct) at 0.7
It’s clear that Copilot has some clear advantages over using Codex, as it can present us several solutions at once (and it’s free). I do wonder what are the parameters that it uses! Hopefully will get more insights into it during the challenge.
Part 2
Part two brought a more complex problem. My first attempt was over complicated and copilot was throwing a bunch of useless code.
I re-framed the problem in my mind and decided to approach it in a different way. (important reminder: AI will struggle to solve complex coding problems if you don’t know the steps to solve it yourself)
After simplifying and attacking it from a different angle, I was very close to a solution. Copilot was struggling again with the iteration aspect of it, almost always going out of bounds. I tried different wording but they either made it worse or seemed to be ignored completely.
Finally I tried to write something more verbose and explicit:
// iterate the array until reaching the last-3 element
// store in counter A the sum of three values from the current position
// store in counter B the sum of three values from the next position
// if counter B is greater than counter A, increment the total by one
That gave me a clean and simple solution which I accepted and passed the second part of today’s challenge.
Codex vs Copilot
Using temperature at 0.7 and the exact same prompt, Codex gave me exactly the same solution as copilot did.
As some of my reader might know, I live off-the-grid, using solar power for electricity. My setup is quite small, a 9-panel ~2800W array, with 9.9kWh of battery capacity.
However, we do have a lot of electrical needs, since we cook with an induction cook-top, have a dishwasher and an electrical water heater. Back in 2019 I wrote Hacking my way through off-grid survival, in which, amongst other things, I wrote how I used a Raspberry Pi mini computer to poll my inverter and upload useful data to a public server. That way I could easily monitor my system. (Yes, modern inverters already have included cloud solutions). But that is not all, I then coded a small program to add some rudimentary “smartness” to my setup. Using a WiFi-enabled smart power plug, I could automate turning the water tank on or off, based on the solar production, battery capacity and time of day. This still required a lot of time and energy on my part, because I need to very frequently keep an eye on things (except when we have sunny days).
About a month ago I started playing with the idea of creating a personal assistant telegram bot. I wrote about it recently, if you are curious. I was mostly interested in getting reminders and my calendar commitments using an instant-messaging platform. I added a couple more extra features in the meantime. It’s public, you can go check it out and use it for yourself as well.
Then I started to connect the dots, it would be amazing if I could have this bot actually provide me with useful info when I needed it. That way, I could ignore the solar system completely and let the bot handle all the automation.
Being off-grid and depending on solar with limited power storage capacity, means we need to always keep an eye on “what’s coming”. Today we may be having a bright sunny day, but if we know tomorrow we will have less than 1 hour of sun, then we need to change the way we use power today. All this concerns are now delegated to the bot.
In order to get data we could trust, I chose to use Meteoblue’s amazing weather forecasting service. It’s probably one of the world’s most advance weather forecasting, with a high level of detail, extensive set of parameters and high resolution.
I identified 4 main things the bot should be able to do:
Let me know in advance(2 days) of upcoming cloudy and/or rainy days
Give me a forecast of sun hours for a 3-day period
Give me direct access to raw meteograms with cloud layers, temperatures and precipitation
Warn me and my wife in case there is a malfunction or dangerous state with the solar system
Number 1 is perhaps the most useful, as it is the one that allows me to stop worrying about the weather and let the bot handle it for me. I set it up so that everyday at 7am it checks the sun hours and precipitation forecast, and only sends me a message if there is anything worthwhile knowing. If the forecast is good enough to not worry, I won’t receive any message.
Number 2 and 3 are manual operations that I can request at any time. I use these If I’m a bit more picky about the forecasting and want to take a better look myself.
Last, but not least, Number 4 is used to periodically check if everything is OK with the solar production and the batteries. This basically checks two things:
solar production is > 0 during the day
battery capacity is > 40% (below these we know we have to be more cautious and monitor the batteries more frequently )
Here’s an example of it working when last week I unplugged the panels to replace a damaged cable
This has been great since now I stopped using my phone so much to refresh a page where I had raw data. I’m also more confident that if I’m away for 2 or 3 days my wife will be able to manage things easily without having to worry, or me having to check on things remotely.
Going Forward
All the recent work on the bot has mostly been dedicated to these private features which only me and my wife can access. I’d like to add more to it, so that the automation of the water tank heater could be done by the bot instead of my previous script. The bot, having detailed forecast available at all times can make much better decisions than anything else I’ve done before.
I’ll also introduce some more manual commands to be able to turn things on/off, and have the bot call certain APIs directly, instead of me having to use different apps on the phone to do so.
My favorite part about being a developer is being able to “scratch-my-own-itch” in a variety of ways 🙂
For a long time I had this dream of developing a digital personal assistant, and finally got started! In these day and age, a personal assistant makes sense to live in a communication app/platform, and Telegram was just perfect for it!
I call it “Ambrósio”, which is a Portuguese name kinda associated with butlers.
For now it has some basic features like reminders, loading up your calendars (from google cal, fastmail, etc), letting you know your daily agenda everyday, quick searching wikipedia, and so on.
But I’m also developing some private (me-only) features in order to have intelligent info regarding my off-grid solar system. I’ll write about that soon.
For now, if you want to give Ambrósio a try, head over to its microsite: https://ambrosio.nunodonato.com. There you can find the link to open a chat in telegram and get started. It also lists all the available commands and sub-commands.
As part of a recent online book club, I spent my last three weeks re-reading Darren Hardy’s “The Compound Effect” on my Kobo eReader.
«No gimmicks. No Hyperbole. No Magic Bullet. The Compound Effect is based on the principle that decisions shape your destiny. Little, everyday decisions will either take you to the life you desire or to disaster by default. Darren Hardy, publisher of Success Magazine, presents The Compound Effect, a distillation of the fundamental principles that have guided the most phenomenal achievements in business, relationships, and beyond. This easy-to-use, step-by-step operating system allows you to multiply your success, chart your progress, and achieve any desire.»
I enjoyed it the first time I read it, but somehow I didn’t get to apply much of the advice. This time I went through it with that intention in mind. I’ve been feeling I should improve some areas of my life and so this was a great opportunity to put it to the test.
What I really like about the compound effect (the effect itself, not the book), is that you don’t need big changes (which often we fail to start or maintain). Rather, it’s all about the small things we can do on a consistent basis.
But we can’t improve what we don’t track. So I bought myself a new journal to exclusively dedicate for tracking progress and planning and setting intentions for my days. (Paper, of course, nothing works better than paper :))
I began by identifying a few key areas where I wanted to improve:
spirituality
exercise
reading/listening to inspiring/spiritual or personal development material
gardening work
career
For each, I set what I call the minimum acceptable value, which is the target I set myself to achieve before 1st September. After that date, I’m hoping that by tracking daily progress I can improve further. But if not, the compound effect will work its magic on the long run 🙂
Spirituality: 30min /day of meditation + 1 silence day /month Exercise: 100pushups/day + 20min active exercise/day Reading/Listening: 20min/day Gardening Work: 10min/day Career: 1 educational video/day Finances: have an emergency fund + begin a long-term savings fund and a savings plan
Although I decided to track daily, my days tend to be quite different from each other. So what I am currently doing is to sum up and do a daily average at the end of each week. I then compare from week to week if I am moving forward or backwards.
Again, these are the minimums I consider essential to maintain regularly. I know I will do some of these much more than the minimum, and others I will have to discipline myself a bit. Besides theses targets, I also identified a few key actions/projects to take on each of these topics to improve them further.
Darren also brings our attention to bad habits which undermine our progress and end up creating bad results in our life (the compound effect acting negatively). One of the major ones I identified for me was the excessive time wasted in the phone. Now keep in mind I have no instagram, no facebook, no twitter or other social apps on the phone. I read reddit or twitter very rarely by using the phone browser. Still, reading news or discord discussions ended up taking too much time. By using the phone’s own tools, I set limits on daily usage (30min) for a few apps, to make sure I limit screen time. Loading the kobo with some new books, keeping it charged and in my bag, also helps in reading more productive things when unexpected windows of free-time show up.
Apart from this, I also took many ideas from Darren’s daily routine for my own. I’ve been sticking going to bed at 22h30, not wasting so much time in useless activities, and waking up at 5h30-06h00. One of Darren’s morning activities which I’ve also began doing is what he calls ‘Daily Calibration’. I do mine at around 7h30 and it’s a sort of daily review and plan, before we actually start the day. His own daily calibration is about
reviewing the top 3 one-year and five-year goals
reviewing the quarterly objectives
reviewing the top goal for the week and month
set three priorities for the day
I especially like the last one, which he calls MVP (most valuable priorities). These are the 3 things that we absolutely must do today. So, even if the rest of the day is total chaos full of surprises, as long as you do those 3, you will at least feel that you moved important pieces in your life/work forward.
I ended up incorporating some of these (and other small tips) on my weekly-review as part of the GTD methodology.
So far this has been great. I love implementing new things, but often abandon them after sometime due to difficulty in keeping up with all the demands. The compound effect makes it simpler and accessible, because it actually prevents you from thinking in big changes. The secret is in all the small, consistent steps.
This pandemic is running for too long. In our home we all feel a growing desire to move, travel, see places, learn new things…. and adding this to this dad’s passion for airplanes…. well, we got ourselves an idea for a different kind of class! We decided to do a virtual flying tour! Our eldest daughter, Lara, who is 5-and-a-half, was really up to it as well.
So I spent a couple of days brainstorming and planning a few things and eventually settled in a trip to learn about the Azores archipelago, one of two archipelagos of Portugal. In this first visit I picked the central group of islands, which is the one where the islands are more close together, which is great since we don’t want the trip to take too long (2hrs max).
But don’t be fooled, the plane ride is really a platform to learn about history, geography and so many things about these islands and our world. 🙂
On the eve of our trip I tried to print a map of the islands and the itinerary to follow. But as you might expect, a true printer will never print when you actually need. So forget the printer! We picked up our coloring pencils and made a map ourselves!
Lara chose the sequence we would fly: departure from Terceira, follow north to Graciosa, go down to São Jorge, Pico and finish in Faial
Finally the day came! During the morning the conversations were mostly around the trip we would be doing in the afternoon. So at this point I thought we need to make this even more fun and do some role-play as well! I made some paper tickets so that this felt like a real trip. I hid one walkie-talkie in the living room, and once in a while I hid somewhere and made some radio announcements regarding boarding times 😂 I don’t even know who is having more fun, me or the kids? ah!
My wife played along and improvised some clothes to look like airport staff and checked the tickets during boarding. Now we are a real airline!
After we all boarded, we set up our equipment, maps and, of course, Lara’s compass! Yes a compass, because this trip won’t have any modern GPS or other navigation aids, we will do it in the old fashioned way following a map and a compass, especially because Lara likes numbers and has been learning about angles lately. Next to our main screen we have a secondary screen with wikipedia (and other websites) which will provide us with information and knowledge about the places we go to. Oh, and Lara’s globe lamp is also here so we can have a really broad view of where we are flying in planet earth 😃
In case you don’t know, the weather in Azores is really unpredictable and unstable. We were expecting a sunny day but we faced some clouds and lots of wind. But even that was good. Here at home we have been trying to build a paper kite, and one of these days I said we need to build a windsock to help us fly. Windsock? What is it? How does it work? Luckily, airports have plenty of windsocks, so we go and check it out before starting the plane’s engines. A windy day is a good demonstration for a windsock! Now we have a better understanding of what we need to build as well!
As we spend some time talking about the country, the Azores, the island of Terceira, the weather also improved and we got a clearer sky for the rest of the journey. After we took off, Lara learnt what are marinas and ports, what are they used for, and why there are so many in the Azores.
After a shourt tour on the island, we need to get moving because our journey is a long one. Next stop: Graciosa island. For that, we now put the compass to work in order to figure what the heading to follow. Let’s hope we don’t make a mistake or we will end up lost in the middle of the atlantic.
About 10 minutes in we have visual contact with the island of Graciosa. I guess the compass did work and our navigation was correct!
Here we read about lighthouses, something that Lara has heard about but doesn’t remember quite well what it is or what it is for, so we explore a bit more on that topic.
As we approach the airport where we should land, Lara identifies the runway.
Quick enough we are back to our map and compass, checking how to go south towards the island of São Jorge. While we fly amongst the clouds, we read and watch a few interesting things about this island. We ended up with a very cool youtube video that shows a lot of beatiful parts of the nature in São Jorge.
Check it out as well: https://www.youtube.com/embed/PKkVt8kmvBU We also read that the north side of the island is characterized by a tall mountain range near the shore. And it is indeed! As we approached we were faced with the tall vertical wall that we struggled to climb, so we thought it would be better to turn east and go around it.
After we went around and started flying towards the airport, Lara noticed something interesting up there in the mountains! What is it?
Oh, those are wind generators, just like we have here near our mountains. They are one of the main sources of energy in Azores. Not a coincidence, we also learnt about many old fashioned windmills still standing in the islands. I guess its the ancient way of harvesting wind-energy, electricity free!
But Lara wanted to check it out closer, so we looked around for a place to land, and managed to take a really good look at it. While we stopped we got to talk a bit about how a wind generator works.
Back in the air, and with the wind generator park far behind us, we get to experience how long and narrow this island is (it is the longest island in azores!).
Finally we landed and made a quick stop to refuel. Looking to the south of the island, we can already see one of the main attractions of this trip across the sea.
Ready for take-off towards Pico island. With this nice weather we can see it from afar!
We live near the highest mountain range in Portugal, but actually it is not the highest if we consider the islands. Pico, which was a volcano is THE highest mountain in the whole of Portugal. And the fact that it is a volcano makes it far more interesting to learn about 🌋 We took this opportunity to check a comparison chart of the highest mountains in Portugal
We barely made it, but fortunately our plane was strong enough to make a good climb so we could take a peek at the top and learn that volcanoes also extinguish and then “close” when the lava melts.
After going around and checking the volcano, we landed in Pico airport to rest and have a snack! (Yes, because this airline is so cool that offers free snacks!). And we snack with a new view to the mountain 😃
We took off towards our last island: Faial! Because it is so close to Pico the trip was very fast. We got into the island coming from the East, right above the main city of Horta (which gives the airport it’s name). One of the most important cities in Azores, also with a big port and marina.
Here we got to know that Faial island also has its own volcano, with a very beautiful scenery inside it. So of course we had to check it out and take a picture with two volcanoes at the same time 😎
This visit to the second volcano messed up our navigation plans, so we had to go back to Horta, turn-around and get aligned again with the runway. But because our trip was coming to a close, Lara wanted to see the ground once again and so we found a nice empty field with the famous lush-green grass of azores 🐄
And finally, we approach the final airport: Horta.
And so ended our journey, after around 1h30m, plus boarding time 🧳😁
After this we brainstormed so many ideas of places we could visit and learn about, but unfortunately my laptop is too old to be able to visit them. I’m already quite lucky that it can even run this game at all 😅
First of all, I hope the title isn’t too catchy or misleading. There are no magic secrets here, actually, it’s all pretty common stuff for anyone that has some experience with any DBMS. But that is, in itself, part of point of this article: that sometimes the basic stuff can be overlooked.
(Editorial note: For privacy reasons I changed the names of several things in order to keep the client identity and industry as less-evident as possible)
I won a contract to build a platform for a client. This was to be used internally but also as a way for the client’s clients to access and analyze data. They had a pretty old platform in place that was aging quite fast and lacked useful features. So they hired a company to get them a more modern platform with a flashy UI. Unfortunately, this company didn’t build anything new, rather they used something they already had and made lots of tweaks here and there to try and fit a round peg in a square hole. The end product was interesting at first, but in a short period of time it began to show its weaknesses. So again the need came to actually get something built from the ground up that met the needs of the present and was ready for the future. This is when I come in.
(not sure if this is even a valid word, but let’s go with it for now)
I recently concluded my 3rd JoMO (Joy of Missing Out) week. More and more I’m finding that spending less time on the smartphone and social media is bringing tremendous value and quality of life (nothing new here, tons of people talking about it).
One small tip I read a while ago was that making our smartphones less interesting was a way to help in the effort. And one interesting way to do that, was to remove the colors from the screen (or greatly reduce saturation). So I went full on and used the Android Developer Mode settings to change the display to monochromatic display.
I absolutely LOVE it for the minimalist and e-book like style. Not sure if there’s a real impact in terms of being less attracted to browse, but it makes me look at the smartphone has a simpler tool than a pretty screen to waste time on.
One other change I did was to use the “easy UI” as a launcher, which is a kind of dumbed down samsung home screen with big icons and no widgets.
I’ve been considering going back to a feature phone, perhaps one of the recent Nokias that also include google maps and calendar sync (two things that I would surely miss), like the 2720 or the 800 Tough. But I also have my eyes on upcoming “minimalist” phones, even though the price point is a bit high for me. Check out The Light Phone and the Mudita Pure.
This is also part of my De-googlifying process… will write about it soon 🙂
My favorite way to play Flight Simulator(s) is by doing sightseeing, VFR trips. I’m not an airliner person. So Flight Simulator 2020 is perfect because there’s loads of detail and everything looks great! I’m loving the bush trips, and hope more will come soon!
The downside of it, especially when using tail draggers, is that its really heard to do a flight purely by VFR when you’re limited to a relatively small screen. It gets boring really fast if you constantly need to use the mouse to look around.
Enter head-tracking. I finally thought it would be a good time to try it. Of course everyone knows TrackIR, which uses a special camera and gear to detect head movements with great precision regardless of lighting conditions. But I was not prepared to spend 200$+ on one, especially considering I never tried it before.
So I spent the last week just trying out different alternatives and decided to write a short blog post to summarize my findings, in case they are useful for people who might want to try this as well.
I installed and used:
ViewTracker
FaceTrackNoIR
OpenTrack
AITrack
FacePoseApp
Most of these options allow you to use different input sources. So let’s see one by one
I used to think my laptop was fairly okay-ish. That was until I started reading the rigs that people have to play FS2020. I’m not into gaming so that explains my total lack of awareness of what is a decent gaming laptop these days 🙂
Anyway, as a fan of flying since the great Flight Unlimited and the old versions of MS FS, I couldn’t skip FS2020. Been playing Xplane for a year or so, but I dislike airliners. My thin is VFR and sightseeing, so MSFS is a clear must due to the amazing world available!
I was greatly disappointed when MS released the official game requirements and saw that my graphics card(GTX 1050m) was not up to the task. I’m really thankful for the fact that we can get this game via XBox Game Pass, which means you don’t have to risk spending 60$ and then not be able to play it.
This is my short summary on how I set up the game to be able to play in an enjoyable manner. Please note that YMMV. Each system is different and there are many factors that impact performance besides cpu, gpu and memory.
For reference, my laptop is a MSI GL62M, with an i7 7700HQ, GTX 1050m and 16gb ram. I installed in the game in the SSD for improving performance as well.
I’ll skip the basics
Needless to say but
update windows
update to the latest graphics drivers
close all programs when you play FS (including the background ones) – you want all the CPU cycles and memory that you can get!
can you overclock safely? If yes, consider doing it. Even a tiny bit can help.
if you are on a laptop like me, make sure your cooling is up to task. My CPU sits at 95-96ºC pretty much the whole game, and this is with the MSI cooler booster turned on
Take all recommendations with a grain of salt
I’ve read quite a few articles and forum posts on how to optimize the settings to achieve maximum fps. Most important: try it for yourself! I’ve seen guys stating things like “turn off this setting and you’ll gain 10fps!!”. No, just no.
How to prepare to optimize the game
First, turn on the developer mode. From the developer menu bar, switch on the FPS counter.
We are not using this just to show fps (plenty of tools can do that), but to understand where is the bottleneck in your system. Below the big fps counter you’ll see “Limited by GPU” or “Limited by MainThread”. This means the bottleneck is your GPU or your CPU, respectively.
This is one of the most important things to do and be aware of. No point in optimizing a bunch of settings that have no impact in the bottleneck you are experiencing.
As far as my research can tell, and it seems to be in line with what others experienced, these are the settings that impact the MainThread (CPU)
Terrain level of detail
Objects level of detail
Online settings
Real-time/AI Traffic
Traffic density
Everything else will relate to the work of the GPU.
I try to get the frame times of the MainThread to be the same as the GPU. If your CPU is your bottleneck, tune the graphics up so you can enjoy the game. Otherwise, work on the graphics but push the above settings up to have a better experience.
Every flight is a new experience
Most people will set up their game to what they find acceptable and then run with it. If you are on a low-end machine like me, forget that. Every single flight I do, I spend the first 5min optimizing my settings. Why?
Because when you are away from dense cities, you can push the graphics up without severely impacting performance. And when I’m flying close to cities, I do the opposite. I mostly fly for bush trips and natural areas so I tend to have my graphic settings mostly in medium and still play at 25-30fps. I have even played a few times with water and clouds on high without any issues. Just remember to adapt the settings to the places where you are.
Optimizing the graphic settings
From my experience (and again, YMMV), these were the settings that had a greater impact on performance.
Render scaling (usually I have it 80, you can reduce more to increase fps)
Texture quality (medium, because I dont like it low, but it causes a considerable hit in performance)
Buildings (usually medium, but if close to cities, low)
Anisotropic filtering (4x, because off makes runways look bad)
Texture supersampling (off)
Shadow maps (1024 – 1536)
Terrain shadows (256 – 512)
Everything else is pretty much on medium. Depth of Field, Lens correction and flare are Off just because I dont like it.
Trees are medium because I think they really make a difference to the scenery. Grass medium as well.
I’m playing at 1080p which is my native resolution and with vsync off (vsync on gives me worst framerates).
How to test
Whenever you make any changes, whether is graphics or data/traffic, after pressing apply and going back to the game, don’t start right away. You’ll see that frametimes will spike. I always wait 10seconds or so. This is the time it takes to apply those settings and load things again. After 10 seconds you’ll notice things will stabilize and fps counter will go up. This is the time you can start playing.
Overclocking and conclusion
All in all, it will depend on the sacrifices you are willing to make. I’m fine playing this game at 20-25fps with an occasional drop in some areas. If you really aim for 30, you might need to tune things down a bit.
I used the MSI Afterburner app to add an extra +200Mhz to the gpu clock, which gives me 2-4 extra fps. Not much but at this level, all frames count 🙂
I started my JoMo week on the 25th of June, and as I wrote on my initial post, I was planning to write on the blog my experience throughout the week. Well, no posts were made since then and now its the 20th of July. I guess that can say a lot about how it went 🙂
I was hoping to be feeling a lot of “things” in the first few days, but perhaps due to the fact that I am not THAT addicted, it went just fine. Also, considering the fact that my free time is scarce, I didn’t really had a problem to deal with boredom.
During the week, it did happen just once or twice that I felt the urge to pull the phone and browse… but it was empty of any “browsing” apps… or so I thought, until I opened my local classifieds apps (facepalm).
All in all, I got to the end of the week just fine and didn’t really miss anything at all. I also used my time better and more productively.
On the first day after the JoMo week I was happy to visit a few couple sites and read whatever messages people might have left me… which were very few actually (terrible social life, I know!).
Since then, I decided not to install twitter or instagram on my phone, nor to enable any shortcuts on my browser to news sites. So now I only check twitter/instagram when I’m on my computer, and I don’t really feel the need to do it at all.
All in all, I really feel some sort of “detox” has been accomplished as I stopped visiting and wasting time in many sites I used to before. Of course that, like in any detox, nothing lasts forever so I’ll be aware of how my tech-dependency goes and will do more of these every X months (X to be defined later).
