LtU's new server

Lambda the Ultimate is now running on a new, faster, more reliable server. The old one is now, uh... pining for the fjords. This should resolve the increasingly frequent outages we've seen recently. Because the old server had started failing, we didn't have time to do as much quality control on the migration as we would have liked. If anyone notices any issues with the site, please comment in this thread. Currently known issues:
  • Non-Latin UTF-8 characters apparently didn't survive the database migration correctly. This is a particular issue if you have a username containing non-Latin characters - you may not be able to log in currently.
  • It's possible that some comments posted later on Monday don't appear on the new site. (Resolved: there were no missing comments)
  • New user signup emails are not yet working.
  • Due to DNS propagation, not everyone will see the new site immediately. (Now resolved)
The struck out issues have been resolved. The remaining issue, with user signup emails, should be resolved in the next few days.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Thanks, Anton!

Thanks, Anton!

Really!!

Really!!

Thanks Anton

Who hosts the site and covers related expenses (like server replacement), if I may ask?

The gory details

I've been hosting LtU on a rented dedicated server that I also use to host various services for consulting clients. As such, hosting was essentially "free", since the server was paid for and had spare capacity.

However, the server that LtU was on had become outdated and unreliable, and for the most part moving services off it was easier than trying to upgrade and repair it. LtU was an exception - moving it proved challenging, because it currently depends on old software versions, particularly PHP 5.2. PHP 5.2 can't reasonably be installed on a modern Linux system via the standard package repositories, since its dependencies conflict. Even if it could be installed, it would result in a rather dubious configuration.

That could of course be addressed by installing it on its own server with the necessary software versions, although that would have started incurring a direct cost. It could also be addressed by upgrading Drupal, but that's a bigger project (one which will now be a bit easier to undertake, with the new setup.)

What I ended up doing instead was to deploy LtU in a set of Docker containers. That worked very well, allowing the software versions that LtU depends on to be deployed to containers which can then be deployed to any server running Docker, without interfering with anything else on the host server.

LtU now runs in four Docker containers: one running Apache with PHP 5.2 and the Drupal code, one running MySQL, and two data containers, one for Apache logs and one for the MySQL database data. This provides a great deal of flexibility for migrating the site between servers in future, and allows it to continue to enjoy "free" hosting.

Wonderfully done

Many thanks.

UTF-8 failures

I received a few SQL errors when trying to post just a moment ago. I'll see if I can reproduce them here:

`?` (U+2192)
`?` (U+3B1)

Here's the error:

user error: Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '='
query: SELECT COUNT(cid) FROM comments WHERE pid = 0 AND nid = 5053 AND subject = 'UTF-8 failures' AND comment = '...(ORIGINAL TEXT)...'
in /home/ltu/www/includes/database.mysql.inc on line 66.
warning: Cannot modify header information - headers already sent by (output started at /home/ltu/www/includes/common.inc:384) in /home/ltu/www/includes/common.inc on line 192.

LtU recapitulates the history of Unicode

Thanks. I believe that's related to known issue #1. It seems the old system had Latin1 as the encoding specified for its database tables, but the front end was rendering with, and accepting, UTF-8. The new config is being a bit more strict about such things. I hope to have that resolved soon.

(P.S. When one googles such things related to Drupal, the posts and comments about it are all about 8 years old. I interpret this to mean that the solutions are mature!)

Some old content still seems corrupted

See e.g. http://lambda-the-ultimate.org/node/5038 (and comments) — my original post contained Unicode characters. For instance, lambda is λ and the em-dash (UTF8: E2 80 94) is —. That's what you'd get if you read the UTF-8 stream as Windows-1252 (the Windows variant of Latin1) — the whole post seems to match quite precisely; by now the stream is probably in UTF-8, but you can still try some variant of:
$res = mb_convert_encoding($field, "Windows-1252", "utf8"); (no warranty!).

It happened to me once in the past (and I used the above for a fix), and while I didn't get to a complete diagnosis, I've learned that since PHP strings are arrays of bytes, PHP is only too happy to store a the bytestream for a UTF-8 string into a Latin1 database field. In that case, converting the database to UTF-8 will decode the UTF-8 bytestream using Windows-1252 and encode it *again* with UTF-8. (Not sure how Latin1 ended up being Windows-1252, but that seems quite common, since Win-1252 is a superset — https://en.wikipedia.org/wiki/Windows-1252#Details). IIRC, the used encoding depends on what the client browser used (which maybe was set by the page encoding), since PHP does no character conversion on its own, but I hope I misremember this detail.

Leaving this alone is also OK

Just to be sure, I'm not asking anybody to fix this. It would be great, and I hope that my tip makes this easy, but given the potential mess, I wouldn't ask dealing with this to my worst enemy!

UTF-8 migration complete

The LtU database has been converted to use the UTF-8 character set.

This should resolve the problem with posting non-Latin1 characters in comments and posts, which was caused by the server migration.

Here are some test characters: ¥ £ € $ ¢ ₡ ₢ ₣ ₤ ₥ ₦ ₧ ₨ ₩ ₪ ₫ ₭ ₮ ₯ ₹

[Edit: due to the nature of the conversion, active logins to the site were terminated, and you'll need to log in again.]

Any users who experienced trouble logging in due to Unicode characters in their username or password, my apologies. You should be able to log in now. If not, please email anton at appsolutions dot com to let me know.

Thanks

for all the hard work.