Photons not allowing to setup WiFi a second time

Hardware
#1

We have a real tricky problem with setting WiFi credentials via softAP on about 100 units…

So at present we have about 1,000 Photons installed working great on site, however a new customer with a rather large market (think millions) wanted a product custom made to their own enclosure, so we simply used the same components re-arranged to suit a different shape board. Simple right?

After producing 100 of these new products, early tests at our offices were positive so we sent them off (Feb 2020).
Next thing we knew they were getting all sorts of problems with the WiFi settings, so we went down to take a look thinking it would be something trivial; not quite. Here we reproduced the problem on several randomly chosen units:

  1. Power on for first time - blinking blue - connect to Photon via WiFi shows “Connecting” -> “Obtaining IP address” -> “Connected, no internet”.
  2. Enter credentials works fine. Lets say the WiFi password was entered incorrectly, the Photon enters listening mode again - blinking blue. No change in firmware.
  3. Attempt to connect to Photon via WiFi and now the connection switches between “connecting” and blank, sometime gets to “checking internet connectivity” for a second, before blanking again. Never able to connect.

All the other solutions to softAP issues we’ve faced before (for example seen in Photon SoftAP mode - mobile cannot obtain address) do not help, including:

  • Power cycling
  • Configuring static IP 192.168.0.2
  • Swapping WiFi antenna (several different ones tried with firmware which specified using external antenna)
  • Loading updated firmware and entering safe mode

The weird thing is, the problem cannot be reproduced at our offices, only at the customer!
The project, due to Corona, has been put on hold but we will need to solve this as soon as lockdown restrictions are lifted which will be soon.

This is evidently a hardware problem (because we have the exact same components running fine elsewhere) so I’m not expecting an absolute solution, but please help as I’m at a loss!!

Next time we test, what is the best way to accurately record what is going on to pinpoint the problem?

#2

If it is an environment dependent problem, you may want to check their wifi bands. A lot of people never address the difference in 2.4 vs 5ghz because their equipment (phones, computers, printers, TVs, etc) don’t care and can connect to both. If they have a 5ghz ssid broadcasting, make sure its a different name than the 2.4.

#3

What device OS version are you targeting?
What SYSTEM_MODE mode are you running?
Are you using SYSTEM_THREAD(ENABLED)?
Are you using retained variables?
Have you tried clearing the WiFi credentials and then tried adding them again?

#4

@ScruffR Not sure what the default OS of the out of box photons, but the OS downloaded (if WiFi details correct) is currently 0.6.2 running automatic mode, no multi threading or retained variables.
I may be wrong but don’t think it’s a firmware issue because we have made 100s of others (slightly different PCBs) using the same batch of photons without these problems.

We did try clearing the WiFi credentials and still unable to connect to the softAP second time.

@Mjones the problem isn’t due to connecting to the customer WiFi but with connecting to the photon WiFi (softAP). But that’s not to rule out the potentially interfering impact of multiple broadcasting frequencies in the environment!

The question is how best to test next time we are there witnessing the issue?

1 Like
#5

I have got circa 1000 photons in products - we use SoftAP to setup the WiFi credentials plus other things around the setup to make the process a little more understandable and predictable.

I am still not clear from your answer which device OS you are using. If 0.6.2 then I think you need to upgrade to 1.4.4 (avoid 1.5.X as there is a memory issue). 1.4.4 properly supports WPA Enterprise which is a must for us.

Again not clear of your answer to @ScruffR question - I use SYSTEM_MODE(SEMI_AUTOMATIC); and SYSTEM_THREAD(ENABLED);

I don’t want to tell you something if you already know but SoftAP uses a lot of RAM and if your free memory is less than 23K + 15K (minimum heap) when you start the setup process then odd shit happens. What I do is check for free memory before entering setup and if it is too low then tell the user and advise a restart. The other thing I do is only ever store 1 credential and before entering a new credential I clear all credentials. I know up to 5 credentials can be stored but with 1 it is much easier to determine whether the user has entered bad data. From what @Mjones has mentioned it could also be that the customer’s WAPs might be setup in a way that does not help the connection process.

You said the new products are in a different box - but you use a external antenna - is that actually working? Do you measure the signal strength and data quality.

I recently had to create a little WiFi’o’meter - Photon + SSD1306 OLED display on a breadboard powered by a powerbank. It just constantly tries to connect to the entered WAP credentials and reads out the signal dB and % quality and whether WiFi or cloud connected (the RGB LED works as well but for a non-technical user not so clear). It highlighted some odd things where “nothing had changed” but a microwave oven was really screwing the signal in one spot. Possibly a different issue - I would try the memory thing first.

1 Like
#6

@armor we’re using the default system mode and no multi threading in our current firmware. We kept to 0.6.2 precisely because of the RAM issues with softAP which we understand all too well - see Listening mode on the Photon cannot work reliably in current implementation
I just checked and the batch of Photons we have come programmed with firmware v0.5.5 by default.

On a separate note, can you point me in the direction of the 1.5.x memory issue details please? We are currently developing on top of this firmware and haven’t noticed any memory issues yet (apart from what has been experienced before).

A WiFi’o’meter is good way to test, as well as dB and % quality, what other specific details would be useful about the environment?

The problem is not related to connecting to the customer WiFi, we are not getting that far. To be clear:

  • The problem is connecting to the Photon itself i.e. Photon-ABCD123.
  • The problem persists across multiple firmware versions, including the factory default firmware.
  • The problem does not appear the very first time you enter WiFi details but all subsequent times. I.e. out of the box, you can connect, disconnect and reconnect many times, but as soon as those WiFi details are sent over, regardless if they are correct or not, you will not be able to connect to the Photon softAP again.
  • The problem only appears at the customer premises (so far). Which is why I’d like to do a wide range of tests while there so we might be able to reproduce the problem back at the lab.