Jun 28

Age of Empires

Excel tables made by me, containing list and tree of buildings, villagers, military units, boats, animals, research and upgrades. Hit points, attack, armor, piercing armor, range, speed, cost, time required to produce, etc.

Download here:
Age-of-Empires.xls
Age-of-Empires-The-Rise-of-Rome.xls

I got Age of Empires I in 1998 from a neighbor, in fact, it was my first Windows-based game, started playing on our brand-new computer with Windows 95 (I had played only DOS-based games, as my first computer had only MS-DOS and Windows 3.1).

It is probably most played game by me, in first year, my “playing” style was just roaming around with the four villagers, trying to hide from attacks. I was too young to understand english, I did not know purpose of Houses (that allows creation of 4 more people), once I built houses but seeing that they do not create any units, I did not build them again. I did not know how to advance through ages, that I need two buildings from each age, etc.

But later, I learned english and read entire Help file and became a great Age of Empires player, frequently defeating computer on any map! I also built about 20 own maps, intended for multiplayer gaming, thinking that in some day I will join a LAN network and I can challenge with other players. I played these maps only against computer.

Got connected to apartment block’s LAN in 2004 and internet in 2005, but I was disappointed that nobody play this game anymore. I never challenged any human.

In 2007 I got Age of Empires II but never enjoyed it so much like first Age of Empires. I hate that the Age of Empires 2 map is so zoomed in, cannot even see a quarter of my city even at biggest screen resolution, in first Age of Empires I could see entire city at once.

In September 2012, due to increase popularity of my Caesar 3 fan page, I decided to create a page for Age of Empires too, as both games were launched almost same time and are played by same kind of people.
Let’s see how many visitors I will get, and if they have any suggestion to improve my Age of Empires fan page!

Age of Empires game review

– I hate that Age of Empires AI is very poor.
– Computer never put villagers in transport boats, to be able to construct buildings and manage resources on other lands.
– On my own maps I banned siege weapons. Computer frequently bring catapults to hand-to-hand fights, they shoot enemy units but the catapult damage area kill own units and allied units too. If you hit allied civilizations 2 or 3 times, alliance is broken.
– I cannot command troops to return in original position after the threat has been eliminated, the computer do this all time. As human, I can only command them to Stand Ground, but they will not move at all, making them vulnerable to archers.
– When I play on hardest difficulty, computer civilizations advance through ages faster than my civilization, I get numerous early attacks of bronze age troops while I am still in tool age, and only with a good city planning and good controlling of troops I can survive. Computer can control individually 50 units at same time, no human can do this.
– If I survive the early attacks, and reach Iron age, I do not get any more attacks! For unknown reason, computer stops creating new villagers if I kill them, so it is unable to get more resources or to repair the buildings, this made computer easy to be defeated. The game is NOT fun anymore!
– I did some experiments, using a small map with 4 civilizations, all enemy each other, plus a 5th civilization controlled by me, allied with all four. I used cheats to reveal entire map and see the computer-vs-computer fights. In one hour 3 civilizations were almost defeated, killed all villagers and they did not had resources to create new villagers, I donated them food, and I revive them. But after 10 hours, the game still had NO WINNER. Computer never take care to fully kill a civilization, they just attack buildings and people that they find in the way, while other buildings remain.
CONCLUSION: if you use a large map and know where to hide, computer will never beat you!

My playing strategy

– I take care of natural features when place the city. Optimal is to built at least 4 towers in a narrow pass and some walls around towers to make enemies to walk in zig-zag within tower range and get shot by all towers before being able reach the towers and do damage to your city.
– I start attacking only when I have created an army with at least 30 units and resources for making a second army.

For more strategies and tricks, just ask me!

Jun 26

Beetle Crazy Cup

Note that this is a FAN PAGE intended for people who already have the game. Do not ask me for link to download full game because I do not support piracy, go and buy it from stores or search yourself in torrent websites.

Beetle Crazy Cup, also know on warez websites as Beetle Buggin’ (probably due to amount of software bugs included in game), or Käfer Total, is one of the worst racing games I ever played… but it can be fun if is played at home with a friend.

Beetle Crazy Cup is the most recent game that can be played with 2 persons at same computer, know by me. Do you know other such games?

See what I made: Beetle Crazy Cup.xls, containing statistics such as vehicle list with car prices and car top speed in each gear.

Game review

Horrible psyhics: Buggy cars have similar acceleration, but the speed makes the difference; Speed cars have similar top speed, but the acceleration makes the difference (see the Excel file for details); with the slowest Speed cars is impossible to reach top speed on normal track.

Lack of realism: walls throw you back with the same speed. In Cross events, is better to crash with full speed in the walls at certain angle, rather than use handbrake and turn without damage the car (cars don’t take damage anyway). Beware that some walls are bugged and you can pass through them!

Gearbox trick: Automatic transmission change to next gear only when the top speed of each gear is reached. This causes waste of acceleration. You can do much better times using manual transmission and change to next gear at redline. But surprise: the gearbox is not saved by replay. In replay the speed shown on tachometer is determined by acceleration rather than actual speed of car, if you select manual transmission the replay will show only 1st gear.

CRAZY TRICK: Select manual gearbox and drive entire track in 1st gear, without raising finger from acceleration. Save the replay, select automatic gearbox then watch how in replay your speed is going crazy! This trick was useful for me to determine the top speed of some cars with slow acceleration, if the road was not long enough to reach top speed (especially in Jump events).

Jun 24

GTA Vice City & San Andreas

Note that this is a FAN PAGE intended for people who already have the game. Do not ask me for link to download full game because I do not support piracy, go and buy it from stores or search yourself in torrent websites.

Probably one of most played games today is Grand Theft Auto. Although I do not like violent games, I still played Vice City and San Andreas around 2005-2007, more as a driving game, not shooting and killing as many is possible (as my friends were doing!), but I also finished all missions of the story line.

I show here the Excel files made by me with statistics about game:
GTA Vice City mission tree, property list, weapons list, vehicle list with their top speed and other info.
GTA San Andreas vehicle list with their top speed and other specs, mission tree, weapons.

I left the world of gaming after 2007.

Jun 22

Need For Speed

Note that this is a FAN PAGE intended for people who already have the game. Do not ask me for link to download full game because I do not support piracy, go and buy it from stores or search yourself in torrent websites.

My favorite racing game was Need For Speed: Porsche 2000 / Porsche Unleashed. I got it in 2003 from a friend. I made this table NFS Porsche 2000.xls, including car list, top speed of each car, written my personal records, and other stuff.

The next Need For Speed: Hot Pursuit 2 was a worsen game, as they moved to Arcade style of racing, no damage. Got it from friends. I made table NFS Hot Pursuit 2.xls, containing car list, car max speed, career track, prices, etc.

Then I was very disappointed when they switched to “underground” style of racing, with only 4 players, the beautifulness of Need For Speed was destroyed for ever!

But, thanks of internet connection, I still played (and finished) the first Need For Speed: Underground, in 2005-2007. Download NFS Underground.xls, my database including career events, list of cars and their performance, list of tuning items, etc.

Later I got older Need for Speed games, currently I have all games from NFS 2 to 7 aka Underground 1 but the Porsche game remain the best! So sad that nobody make anymore such beautiful games.

To make NFS series enjoyable again, they should make a NFS game with a free mode to drive around the city, like Grand Theft Auto and Midtown Madness, to reintroduce damage and to offer daylight races (daylight racing do exist in NFS Most Wanted but were removed again in subsequent games). LOL! I found in 2014 that exactly the game following the last game I played, Need for Speed Underground II, introduced free roaming concept. But nowadays I no longer have time to play it.

Jun 20

The Sims 2

The Sims 2 is my favorite game, beside making functional homes and playing the game in normal way, I also practiced my urban planning talent by building planned cities with decorative apartment-like blocks.

I had played The Sims 1 too and made nice houses, but I don’t think that worth to post here because today nobody play it anymore. I never entered in The Sims 1 since I have The Sims 2.

Since February 2013 was The Sims 2 section was moved a separate WordPress installation (sub-website).

Enter The Sims sub-website

The Sims 2 fan page has been initially made in 2009 as ONE page on teoalida.webs.com.

Since September 2012 I made a new website teoalida.com to replace the crappy Webs.com one, and The Sims 2 section was a Category with 30+ pages.

After adding non-gaming stuff to teoalida.com, I decided on 1 february 2013 to give to The Sims 2 a separate sub-website instead of a category, URL remained the same: www.teoalida.com/thesims and I added a bit about The Sims 3 as well! See List of updates.

May 10

Books and databases Word / Excel

I offer writing, data entry, data mining and web scraping services!
List of 50+ Word / Excel projects done so far
Incomplete list, I made so many projects since childhood… that I forgot them!
I will add on website more projects, once I remind about them and make sure their quality is good.

 

Project File
type
Size
(KB)
Pages /
rows
How was
made
Date made /
maintained
World geography
Solar System (Word version, DELETED) DOC manual 2000 ?
Solar System (Excel version) XLS 45 manual 2014
World countries & facts
(Word, based on old atlas, DELETED)
DOC manual 1998-2000
World countries & facts (Excel, based Encarta 2002) XLS 81 ~200 rows manual 2004
World cities population (original version, DELETED) DOC 727 130 pages manual 2003-2005
World cities population (Word simple) DOC 477 50 pages manual 2016-present
World cities population (Word detailed) DOC 781 150 pages manual 2016-present
World cities population (Excel detailed) XLS 1075 7500+ rows manual 2016-present
World tallest buildings database XLS 5425 15000+ rows scraping 2015
United States all buildings database XLS 91627 160000+ rows scraping 2016
Singapore real estate
Database of HDB Blocks XLS 6000+ 14000+ rows manual 2009-present
Database of HDB Resale Flat Prices XLS 24307 160000+ rows copy-paste 2009-present
List of BTO & DBSS projects XLS 103 300+ rows manual 2009-present
List of BTO prices XLS 183 700+ rows manual 2015-present
List of SERS sites XLS 49 80 rows manual 2009-present
Condo Database SingaporeExpats XLS 2981 3100+ rows scraping 2015-present
Condo Database PropertyGuru XLS 2334 3200+ rows scraping 2016-present
Managing Agent Database XLS 1185 4200+ rows scraping 2017-present
Hong Kong real estate
Hong Kong Public & Private Housing Estates XLS 592 1000+ rows manual 2011
Hong Kong Centadata Housing Estates XLS 495 3200+ rows copy-paste 2016
Romania geograpy – download from www.teoalida.com/ro/geografie
Geografia Romaniei (geographic features) DOC 198 23 pages manual 1998-2006
Drumuri nationale (list of roads) DOC 72 6 pages manual 1999-2006
Cai ferate linii (list of railways) DOC 74 6 pages manual 1999-2006
Cai ferate linii & statii (list of railways with stations) DOC 347 51 pages manual 2000-2006
Impartirea administrativa interbelica (1925-1940) DOC 166 11 pages manual 2006 ?
Impartirea administrativa in regiuni (1950-1968) DOC 81 8 pages manual 1999-2006
Impartirea administrativa actuala (1968-prezent) DOC 105 10 pages manual 1998-2006
Populatia judetelor si oraselor (city population) XLS 213 320 rows manual 2004-2006
Automobile research – download from www.teoalida.com/cardatabase
Car Models List DOC 403 59 pages manual 2003-present
Car Models List XLS 1545 4500+ rows manual 2012-present
Car Nameplates List XLS 524 3000+ rows manual 2016-present
Car Models Timeline XLS 584 manual 2003-present
Car Models Encyclopedia DOC 1680 360 pages manual 2005-2013
Car Models Database XLS 1346 3500+ rows manual 2005-present
Car Models & Engines Database XLS 13532 18000+ rows manual 2003-present
American Year-Make-Model XLS 1567 14000+ rows manual 2013-present
American Year-Make-Model-Trim-Specs XLS 74720 50000+ rows scraping 2014-present
Indian Car Database XLS 17152 3000+ rows scraping 2015-present
German Car Database XLS 250178 90000+ rows scraping 2016-present
Australian Car Database XLS 96467 90000+ rows scraping 2017-present
Motorcycles Database XLS 24569 30000+ rows scraping 2016-present
AutoKatalog Statistics XLS 212 manual 2012-present
Automobile Production XLS 130 copy-paste 2012-present
Automobile Sales Figures XLS 833 scraping 2017-present
Computer & technology
Screen size calculator XLS 50.5 manual 2014
Screen resolution statistics XLS 326 copy-paste 2014-present
Screen resolution statistics by country XLS 2380 copy-paste 2014-present
Mobile Phones Database XLS 8968 8000+ rows scraping 2016-present
Gaming stuff – see www.teoalida.com/games
Age of Empires DOC 208 manual 2001 ?
Age of Empires (base game)
(table of military units)
XLS 106 manual remade 2007?
Age of Empires: The Rise of Rome
(table of military units)
XLS 112 manual remade 2007?
Beetle Crazy Cup
(vehicle stats)
XLS 71 manual 2002?
GTA Vice City
(mission tree, vehicle stats)
XLS 117 manual 2005
GTA San Andreas
(mission tree, vehicle stats)
XLS 134 manual 2007
Commander Keen 4 – Second game I ever played!
(statistics of levels and items)
XLS 117 manual ~2000? DOC
remade 2007
Midtown Madness 1
(vehicle stats)
XLS 40 manual 2003
Midtown Madness 2
(vehicle stats)
XLS 35 manual 2005
Need For Speed: Porsche Unleashed
(vehicle stats, personal records on every track)
XLS 217 manual 2003-2006
Need For Speed: Hot Pursuit 2
(career levels, vehicle top speed stats)
XLS 58 manual 2003
Need For Speed: Underground
(career events, vehicle performance, tuning items)
XLS 161 manual 2006
Quake 3 maps statistics
(not yet public due to messy work)
XLS ? manual 2000-2007
The Sims 2/3 List of houses made by me XLS 24 manual 2013
The Sims 2 Career Tracks XLS 219 copy-paste 2012
The Sims 2 List of Items XLS 216 manual 2012
The Sims 3 Worlds and List of Lots XLS 398 manual 2013
Miscellaneous works
Music Database XLS 2200+ 6000+ rows manual 2005-present

About me

Since childhood I love writing books, doing research, making databases and statistics. I started using computers in 1997, my dad taught me to use Word, but around 2003 I started using Excel more than Word. Analyzing data, making tables and charts about everything encountered in my life! For example, in racing games I measure the speed of each car and write the numbers in an Excel spreadsheet then make a chart.

Early works were pure hobbies, made from personal interest. Hong Kong Housing Database‘s expansion with private estates, was the my FIRST large project done for a customer, an insurance company, in 2011.

Other works such as Car Database and HDB Database were started as hobby for my personal use, but had an unexpected turnout into business after 2012, and now I am updating them regularly to sell for professional use.

Some projects (example Database of HDB Resale Flat Prices) involve copying the data from a source website and pasting in Excel, then few visual adjustments to make it beautiful, which takes just few hours to create a 20 MB Excel database.

Other projects (example Database of HDB blocks) involve compiling data from various sources and manual data entry in Excel, taking hundreds hours of work!

Starting from 2015 I learned web scraping. Scraping usually means running a software to visit a list of given pages, extract specific data and put it in a database automatically. This allow me to create very large databases with a minimum of work, leaving scraping software to run in background for few hours or days.

All my projects are made primarily for visualization in Excel, but some (especially the Car Database) are often used by professionals who are converting the Excel spreadsheet to CSV and MySQL and use in web design and mobile app development.

Working style

My parents encouraged me to work in Microsoft Word, and told me to finish and print the work because “what is not finished have ZERO value“. I never understand why they wanted to print… some works for example Car Database should NOT be printed and cannot be “finished”, it need to be updated constantly with new launched cars. They promised me that will help me publishing a book… but this never happened (there is a possibility that they encouraged me just to give me a solitary occupation at computer to prevent me disturbing them, instead of letting me to have a social life).

My dad even set me rules, how a book should be written: Arial font, 12pt body text, 16-20pt titles, all titles centered, bolded, underlined. However, since my writings were not really a book but a list of… something, the rules imposed by dad created excessive bold and centered text.

Around 2001-2003 I got fascinated by Notepad and by fixed-width font and I was using lines of — and === signs full page width to enhance titles.

Since 2003 I broke away from dad rules and started using Excel more than Word. New works in Word were optimized for on-screen display instead of printing, often using non-standard page sizes, to make exactly 1 page for each subject. I write with 10pt font for body text, 20pt and 15pt for titles, 10pt and 5pt for empty spaces.

Since 2003 for both Word and Excel works, the titles were white text on blue background for full page width, which does not look very well on paper. I used same style when created my website in 2009.

Since 2010, one of the distinctive features of all my Excel works are the coloured columns, older works were coloured to this format too. I combine the Excel databases with my graphic design hobby, making Excel files also artistic!

Since 2015 I changed the standard of Word files, removing full-width coloured backgrounds of titles and putting instead full-width horizontal lines (similar with what I was doing in 2001-2003 in Notepad). This will be better for printing (even if I assume that nobody will print my works). I changed also my website design to this format.

One of my friends said that my website looks like being made by an expert in typography rather than by a webdesigner!

Example of styling in my books: 2012, 2013, 2015 editions of Car Models Encyclopedia
  

I also done some kind of competition between my works, a race to create biggest database in Excel or biggest book in Word, in terms of pages and file size, under certain standards (10pt font, no duplicate stuff, no large open spaces, NO bullshit but useful content, etc). I kept track of file size in an Excel table similar with above table.

May 06

World countries and cities database

Geography is my oldest hobby, starting around 6 years old I was studying geographic atlases and already learned all the countries and capitals. Between 1998 and 2005 I done few works in Word / Excel based on World atlas books or digital encyclopedias. Here are few of them:

World cities population

World city database World city database

I compiled this Word file starting from 2003, initially sourcing data from Encarta Encyclopedia 2002 that I got from a friend. It was the ONLY recent geography encyclopedia I had, all others being world atlas books from my parents childhood (1970s). I did not had connection to internet until 2005 to get other sources of data.

Over next years I improved the Word file using Encarta 2006 and 2009, completing all countries and included about 3800 cities over 100,000+ and additional 3000 cities over 20,000+ from selected countries. Since 2016 I offer also an Excel version beside the Word one.

Administrative divisions (states, regions, provinces, etc) are included for 30 most major countries, second-level administrative divisions are included only for Italy at this moment, but I am able to add them also for United Kingdom, France, Spain and United States if you want.

Download FREE samples

World Cities Database simple version .DOC
World Cities Database detailed version .DOC
World Cities Database detailed version .XLS

Buy full city database

Buy & download

City database history

2003-2005 – I compiled list of cities of Europe, former USSR countries, Middle East and Africa. Using Encarta 2002, which have a limited amount  of cities shown on map so I was planning to include ALL cities shown on map, meaning cities over 20.000 people, but for biggest countries of Europe would have been too many so I have included only cities over 100.000 people.

2005 – my family installed internet connection. I discovered Wikipedia and no longer saw a purpose of making my own world cities database, the internet provided already up-to-date population numbers and updating my table constantly is a waste of effort. I left geography and migrated to other hobbies such as architecture, without finishing the list of World Cities as intended (to include all cities over 20,000 people from EVERY country).

2006-2007 – I included few more countries: China, Japan, Mexico, etc, using Encarta 2006, this one having a lot more cities shown on map, would take a lifetime to include all, so I decided to include only cities over 100,000+ people. Then I let the city database abandoned.

2015 – given by the success of one of my other hobbies, Car Database, which turned into a business by selling Excel databases to businesses and web developers, I started questioning whenever the World Cities hobby, if converted to Excel, may be useful for web developers for CSV and MySQL databases. I published for the first time the incomplete city database on my website, one-country SAMPLE, inviting people to contact me if they wants the Word file for free, or Excel conversion as paid service.

Over next months I completed remaining countries from Asia, North and South America, including cities over 100,000 people, using Encarta 2009 (last Encarta). I created 2 Word files, one for all countries including cities over 100,000 (60 pages) and one for 20 biggest countries, including cities by province over 20,000 or 100,000 depending by case (70 pages).

2016 August – first person contact me to ask for city database. He wanted list of cities in Excel, I offered him to convert the Word to Excel but he was not patient and asked me to give what I currently have (the Word file). However, I started converting it to Excel to be ready for sale when next customer is coming. I created 2 Word files, both containing all countries, LITE one containing cities over 100,000 and BIG one contain cities over 20,000 by province, plus the Excel file similar with Word FULL one, and put them for sale so people can buy directly (instead of contacting me get complete database). Also expanded the page to get more traffic from Google.

The city database currently contains 298 cities over 1 million, 316 cities over 500,000, ~3000 cities over 100,000 and additional ~3000 cities over 20,000 in selected countries. It is NOT FINISHED and will never be 100% complete, but may be sufficient for your needs, if not, I can do additional work if required, such as adding cities between 20,000 and 100,000 people from countries where they are not yet added, or do changes in data structure to make it more suitable for your project. Contact me and tell me your requirements!

Note: city classification is done based on the icon shown in Encarta Encyclopedia 2009, and it do not always reflect the actual population indicated in city article. For example there are cities with icon of 1,000,000+ but having population around 900,000, as well as cities with icon of 500,000+ but having population over 1 million. Cities under 100,000 do not even have article to indicate exact population. This was Encarta Encyclopedia, the only resource of information available for me before connecting to internet.

City database per country

Romania city population .XLS – I made originally in 1999 in Word sourcing data from books then remade in 2006 in Excel format sourcing data from Wikipedia pages of each city (hours of work!). It does contains all 320 cities of Romania with their population at every census from 1912 to 2011 (next census probably in 2020) except when they did not had city status at the census year. Why Romania? Because here I was born.

United States city population .XLS – including 304 cities with over 100.000 inhabitants. Source of data: Wikipedia, copy-pasted in Excel and enhanced visually. Contains population at 2010 census, 2015 estimate, as well as area, density and GIS coordinates, latitude and longitude.

If you want for other countries, please ask!

Note: list of cities from certain countries can be also found on government census pages, for example http://censusindia.gov.in/Tables_Published/Admin_Units/admin.html – List of Towns in India – 5161 towns. If you can’t find a ready-available list of cities, contact me and I will see what I can compile from Wikipedia.

I think that I can also make a worldwide database of cities, sorted by country and administrative divisions, preferably without population because require too much effort and each country have different census year. But before starting this megalithic work I need to know who would need such database. Please tell how do you intend to use city data and what info / columns the database should contain!

World countries database

World Countries Database .XLS – I compiled this Excel file in 2004 based on Encarta Encyclopedia 2002.
Contains country area (sq km), population, density, growth rate, and projected population for 2025 and 2050.

New: Countries Database sourced from The World Factbook, made in 2017 via web scraping and include regular updates. Contains 362 columns of facts.

Other geography stuff

In 1998-2003 I also wrote lists of natural features, seas, rivers, etc, and astronomy-related stuff…. all in Word. I started using Excel more than Word in 2003. Today I consider them useless because such info exist for FREE on Wikipedia and is not necessary to make my own databases.

May 04

Buildings database

Looking for other kind of buildings database for any country? Contact me for a quote!

After making databases of HDB and condos from Singapore, as well as public and private housing estates from Hong Kong, and other databases, in November 2015 I started making a database of skyscrapers… finalized it in January 2016, having over 15,000 buildings taller than 100 meters.

This was done soon after learning about web scraping in August 2015. I made the skyscrapers database for purpose of showcasing my ability to create databases by scraping data from websites, and for my personal interest in studying evolution of skyscrapers over history.

Skyscrapers database, tallest buildings in the world

Download SAMPLE: Skyscrapers Database.xls

Under construction buildings are included so the database will be valid for next 3-4 years. I will update the table depending by how many people buy it.

Summary database

FREE version, containing:
Tallest buildings today 300 meters / 984 feet, 218 buildings, completed and under construction
Tallest buildings in year 2000, 1980, 1960, 1940, 1920.
Timeline of tallest buildings in the world, in United States, and outside North America.

 

FULL database

All buildings over 100 meters / 328 feet, 15727 buildings, completed, under construction, planned, vision
Sorted by city (~600 cities having buildings over 100 meters), can be re-sorted by height or any other column.

 

Buy & download

How the Excel database was made

Identify on map the cities with many buildings, check them on Emporis, make a list of skyscrapers for each city (most cities checked do not have any skyscrapers), then input list of URL in scraping software to get details about each building and put in Excel table, then enhance Excel table, remove day/month from construction dates (leave only year for easy historical analysis), etc… dozens hours of work!

How the Excel sheet can be used

Filter the table and make top tallest buildings by country, state, city, building usage, etc.
Filter the table by year and make top tallest buildings in any given year of history.
Analyze data and make statistics what cities have most buildings over 100, 200, 300 meters.
Convert Excel file to CSV or MySQL and create your own skyscrapers website or mobile app.
Etc…

New database: 160,000+ buildings from United States

In April 2016 someone seeing my skyscrapers database asked me if I can create a database of buildings in Ontario state of Canada. DONE!

In November 2016 someone asked me if I can scrap data from Emporis to create database of not just skyscrapers but also high-rises in United States! DONE in about 5 days!

Buy FULL database:

Buy & download

He further asked to include low-rise buildings. So I decided to re-scrap website with all types of buildings and also included all 50 data fields and no just the ones of my and his interest.

DONE in about 2 weeks, including 20 hours of manual work to build the list of URLs for all buildings then many hours of scraping. Emporis have an anti-scraping feature blocking my IP after accessing 1000-2000 pages, so had to run in batches of 2000 buildings (taking 15 min each) then join the files and re-scrap blocked URLs. A huge effort than deserve this price, not counting highly valuable information collected.

Download SAMPLE: Buildings Database.xls

Buy FULL database:

Buy & download

These 163,938 buildings are not all buildings ever built, but all buildings included by Emporis as December 2016 (except New York City, note below). Maybe not 100% complete, but still the BEST resource of building information that you can get.

Emporis include famous buildings, and most (if not all) large public buildings, commercial buildings, churches, etc. But in case of residential buildings most are not included because are not famous.

Note for New York City: this is the only city in the world where every single building was included in Emporis, including 390,000+ low-rise buildings and 320,000+ houses (more than double of whole rest of US). Would have taken extra 30 days to scrap them all, and the customer said “need few dozens buildings from every US city” and “in case of NYC scraping high-rises and skyscrapers is more than enough”.

Meantime the original skyscrapers database did not had any sale… so I changed page name from “Skyscrapers database” in “Buildings database” and published the US all-buildings database, in case other people are interested too.

History of skyscrapers

United States is well-known for skyscrapers, but in reality only a small area in the downtown have skyscrapers, and the era when United States was the only country with skyscrapers ended long time ago. A lot of high-rise buildings were built since late 19th century. What is less known, is that early skyscrapers were not so well received by population and most US cities set height limits to counter the “skyscraper race”, but in New York the law failed to be approved, so taller and taller skyscrapers were built. Early skyscrapers had continuous facade at street line, ugly side walls and airwells, making street to look like canyons. 1916 Zoning Resolution prevent buildings to cover entire plot of land.

The 1930 recession ended skyscraper construction in North America, for about 30 years no more tall buildings were built. Between 1933 and 1953, in entire world were 19 buildings over 600 feet (183 m), all of them located in United States, 17 of them were in New York alone (source).

Nice find: http://wirednewyork.com/forum/showthread.php?t=21249 – a lot of vintage photos of skyscrapers taken from 1900s to 1930s.

A thing less known, Russia attempted to take away the title of world tallest building from USA, with Palace of the Soviets started in 1938, but due to the World War II the construction was abandoned. After war, seven smaller but still megalithic buildings were built. Moscow State University completed in 1953 was the tallest building outside United States, until 1975.

Since 1990s a new skyscraper race began, probably helped by computer technology. New buildings over 300 meters appeared in Malaysia, China, Taiwan, as well as Europe. The world had 26 completed buildings over 300 meters as 2000, 53 as 2010, 126 as 2015, and 218 including under construction ones, according my database.

Asia started building skyscrapers with over 200 meters slowly during 1980s and nowadays it have most skyscrapers under construction.
Singapore’s UOB Plaza was tallest building outside United States between 1986 and 1989, and remains tallest in Singapore due to the height restrictions.

Malaysia surprised whole world in 1998 when completed Petronas Towers with 452 meters, taking the title of world tallest building from United States, and now is constructing KL118 with 635 meters, which in 2020 will become 3rd tallest in the world.

China had in 2000 only 4 of the world’s 25 buildings over 300 meters, and now it does have 98 of the 218 buildings over 300 meters according my database (including under construction).

Buildings over 500 meters have been proposed also in India, Indonesia, Philippines, South Korea. These countries may join the race during 2020s. How the earth will look like in 2050?

Latin America has been building skyscrapers since 1930s, Martinelli Building (built 1934, 130 meters), then Altino Arantes Building (built 1947, 161 meters), being also the tallest building outside United States. But the evolution was slow and not much taller buildings were built over years. Presently Brazil does have few hundred buildings over 100 meters, mostly residential, but the tallest, Mirante do Vale (built 1960), is only 170 meters. Tallest skyscraper in South America was Parque Central Complex built in 1983, only 225 meters until 2014 when Gran Torre Santiago was completed, with 300 meters.

Europe is the place where skyscrapers enjoyed little popularity, except Russia. Most skyscrapers of Europe are located in Moskow. Eiffel Tower was the tallest structure in the world from 1889 to 1930.

Middle East does have relatively few buildings over 100 meters but between 2012 and 2015 it had the two tallest buildings in the world, Burj Khalifa and Makkah Royal Clock Tower, and now is building a new world’s tallest, Jeddah Tower, 1 kilometre high.

Skyscrapers statistics

Total buildings in database: 15727 (as January 2016)

By type:

10212 existing buildings
1867 under construction buildings
1833 planned buildings
1764 unbuilt buildings (cancelled / vision)
51 demolished buildings

By region:

4142 North America (US & Canada)
1031 Latin America
519 Australia & New Zeeland
1395 Europe (including Asian countries of the former Soviet Union)
1301 Middle East
412 South Asia
1424 South-East Asia
5377 East Asia
126 Africa

Countries with most buildings:

3983 China (including Hong Kong and Macao)
3383 United States
846 Japan
759 Canada
590 Brazil
550 United Arab Emirates
526 South Korea

Cities with most buildings:

1327 Hong Kong (1270 completed)
879 New York (670 completed)
478 Tokyo (412 completed)
470 Dubai (247 completed)
464 Chicago (297 completed)
438 Toronto (222 completed)

 

Year Number of buildings with over # meters
  150+ 200+ 250+ 300+ 400+ 500+ 600+ 700+ 800+ 900+ 1000+
1910 3 1
1920 10 2
1930 47 5 2 1
1940 66 10 5 2
1950 69 10 5 2
1960 86 13 5 2
1970 154 25 8 3
1980 320 71 18 7 3
1990 592 143 36 13 3
2000 1051 255 68 26 6
2005 1516 371 93 31 8 1
2010 2258 603 154 53 14 2 1 1 1
2015 3444 1135 349 126 26 6 3 1 1
incl. U/C
excl. planned
4115 1503 533 218 55 21 7 3 2 1 1

See how many tall buildings were built starting from 1980s and especially during 2000s, probably helped by computer technology. How the world will look like in 2050?

May 02

Teoalida’s Music Database

Probably one of most USELESS things that I ever made…

Starting from 2005, I created in Excel a database with the songs that I downloaded or 30-seconds samples from iTunes Music Store, to review each song and give a rating from 0 to 16, and make top best artists, best albums, best genres, etc, using complex mathematical formulas, that show you exactly what music I like and how much.

The music database include most of my favorite artists / bands, but also few artists / bands that I do not like, selected to be representative for each region of the world and each music genre.

Last release: July 2016 with 6000+ rated songs. Download FULL database for FREE!

Note: if you came there looking for a different database about music or any other database that can be made in Excel, contact me and I will tell you if I can build it! See other databases made by me.

Music Database

Some local friends, the ones who know me in real life or the ones I sent my music to them via internet, blamed me for listening to the shittest music possible. What is the problem if I rarely listen music from my own country? if I can speak 4 languages and I listen music in languages that they do not understand, as well as other languages that I do not understand myself too, does not mean that the music is a fucking piece of shit. I love collecting music sung in as many languages possible and I do not always care about the lyrics.

Also the friends said that this Excel Music Database is the craziest thing made by me, or most useless thing they ever saw, and suggested me to STOP wasting time doing such things.

I agree, I may be the ONLY one person in the world having such crazy detailed database showing personal musical preferences, and yes, I am aware that is USELESS… that is why since 2009 I am paying little attention to Music Database, adding new songs at a slower rate, 2.5 years passed to raise song count from 4000 to 5000, and migrated to other hobbies, such as making other (more useful) databases.

What is your opinion? Leave comments!

How my hobby for music started

Hobby for music started in 1999, after replacing our 486 computer with 200 MB hard disk with an AMD K6-2 333 Mhz with 4.3 GB hard disk, my dad brought some CDs with mp3 songs, mostly pop and rock songs from 1960s to 1990s, and made a selection of songs according his own preferences, unfortunately deleting many songs that I liked. The he burned the selected songs on 2 CDs. I had no rights to decide what to listen, only parents were putting music in our home, and for many years, my dad’s songs selection was the only music I was listening. I wonder, if I did not had these restrictive parents, were my music preferences different today?

Out of my dad selection, I also made own selection of few dozens songs which I was listening only when I was home alone.

After 2003 revolution and removal of restrictions imposed by family, I was able to listen my music anytime I wanted, and soon I got bored by my few dozens songs, I was desperate to get more music, and started recording via TV-Tuner (ending in having lots of songs in bad quality). I wanted more songs from certain artists, I went to music stores in the city but my parents did not agreed to pay money for music CDs.

In 2005 we connected to internet so I was able to download music freely for first time using DC++ file sharing network (Youtube was not yet launched). In November 2004 I accidentally turned on TV when was Junior Eurovision Song Contest, won by Maria Isabel. So, first songs that I downloaded after connecting to internet were Maria Isabel’s 2 albums and 2 more children artists discovered while looking for Maria Isabel: 3+2 and Danna Paola, additional songs from the artists I already had songs (Aqua, Shakira, Shakin Stevens, Thalia), also originals of about 100 songs recorded from TV in bad quality.

In 2006 while looking on Youtube for Danna Paola I found accidentally a video featuring Tatiana, so I started looking for Tatiana music too, on ARES (file sharing software popular in Latin America) and direct downloads (like MegaUpload) and by this way I downloaded also Fandango, Flans, Timbiriche, R.B.D, and got addicted to Mexican 1980s-1990s pop-rock. In 2008 I had 3000+ songs of which 30% being from Mexico. Tatiana remaining my all-time favorite even in 2013. In the same time I started watching Mexican TV shows and I learned Spanish.

I was looking for more diversity, so since 2009 I also downloaded music from other Latin American countries, and got addicted to Brazil country music as well as 3 big artists hosting children shows (Angelica, Eliana, Xuxa), which generated bad comments from my overseas friends (are you retarded? why do you listen to children music?), by this way in just one year I learned Portuguese to the level I am able to write lyrics of any song. I also downloaded American country music (Alan Jackson, Garth Brooks, Shania Twain, Taylor Swift, etc), British, French, German, Italian pop, rock and folk (ABBA, Al Bano & Romina Power, Alizee, Andrea Berg, Ricchi e Poveri, etc), Japanese and Chinese pop music (many small artists), I liked all them but none caused long-term addiction until 2013 discovery of Kyary Pamyu Pamyu. There is also music that I can’t tolerate: Arabic and Indian music.

The idea of creating an Excel music database

The idea of using Excel to make table with songs, and rate each song, dates back from 2002. I added all songs in WinAmp, generated HTML playlist and copied into Excel, then added a numerical rating. This means no complete discography of any artist, no year known, etc.

In 2005, thanks to the internet connection, access to internet music stores and filesharing networks, I could get information about artists and complete discographies, with album names and release date, I decided that is the time to start making a serious music database.

Source of data: primarily iTunes Music Store (copying album by album with just few clicks, so columns in my database were matching columns in iTunes until it was redesigned in 2010 thus I had to copy song by song), secondary Amazon Music Store. The the italic song titles are taken from MP3 filenames found on the internet so their spelling accuracy is lower.

I did not intended to make a database with ALL songs from my computer, also I did not intended to reach a certain number of songs at a specified deadline. I just added artist by artists at random basis, originally adding only my favorite artists (most of them having short music career), and since 2008 I paid attention to famous artists, adding in database a selection of artists representative for every region of world and every genre of music.

Music database evolution:
2000 songs, 37 artists in top – June 2007
3000 songs, 57 artists in top – February 2008
4000 songs, 71 artists in top – August 2009
5000 songs, 92 artists in top – April 2012
5437 songs, 97 artists in top – late 2013
6000 songs, 105 artists in top – June 2016
Note: the top include only artists with minimum 10 songs and at least half of their songs rated.

Songs rating system

Since the Music Database was started in the era I was fascinated by Base-16 numbering system, the songs are rated with numbers ranging from 0 to 16, originally lower values being better, but in 2016 I inverted the ratings, making higher values better. Total: 17 possible values, which is my birthday and my favorite number.

Rating is composed from 4 categories, each having value from 0 to 4.

Sound: I love instrumental diversity and guitars. Rock and country songs win rating 4 in this category, while hip-hop songs have rating 0.

Voice: I love nice voice and lyrics diversity, but I don’t care about the lyrics content. The songs sung in languages unknown by me or artificial languages can win rating 4 too. The rating drops if lyrics contains too many repeating words, or if the song is only instrumental, the rating is 0.

Mix: I love the songs which have a continuous and fast rhythm. Dance songs can win rating 4 in this category. Rock songs have rating 2-3, Pop songs have rating 1-3, slow songs or bad mixed songs gets rating 0.

Addiction: some songs attract me so much that I listen them again and again for hours, they win rating 4 in this category, they are bubblegum dance, Japanese pop as well as songs from children show of Latin America (this is what attract negative comments from my friends, that I listen childish music, music for retarded people, etc). Rock and country despite of winning in other categories, makes me bored after listening few times so they have rating 1-2, while the louder songs like hard rock which make pain for my ears that I cannot listen a song until its end have rating 0.

To rate each song, is enough to listen 30-second preview on iTunes, but I prefer to rate only when I download full songs. Addiction rating is hard to be decided initially and sometimes I modify it after days or months. The 17 ratings are distributed like Gaussian curve, but asymmetric, rating 8 having 10% of songs, rating 0 having 2% and rating 16 having 0.2%.

My everyday playlist is composed by songs rated from 12 to 16, including songs with rating 8-11 temporarily and keep them if rating is 3 or higher. This create a playlist of about 20% of songs included in database.

Artist ranking system

In 2005 I made a ranking based on average ratings of all songs of each artist. But this turned into a problem: the top places were occupied by small artists that produced just few but good songs, while the most famous artists occupied last places. Is natural that the artists with long career to not be able to make many songs good as the few good songs.

In 2006 I added a SCORE for each artist calculated by a more complex formula. I added columns for number of songs and the total value of songs. Song value is calculated like inverted binary logarithms: value 16 divided by every rating, exception for rating 1 which have value 12 and rating 0 which have value 16.

In 2008 I further improved the ranking by adding a multiply factor for song diversity, calculated like this: total value of songs divided by number of songs divided by average song rating, sum resulted square rooted and and multiplied by 2, resulting a multiply factor between 1 and 1.5. Artists having diversity, few good songs in a total of mostly bad songs, are helped by having higher multiply factor than the artists who have all songs at same medium rating.

How the score is calculated: average song rating (ranging 0 to 16) multiplied with 4 (I can increase this multiply factor to boost artists with one but good album or reduce the multiply factor to boost artists with long career), plus square root of total value of songs (ranging 4 for one-album rappers to 30 for Tatiana’s 20+ albums), sum of these 2 is multiplied with diversity factor between 1 and 1.5, them multiplied with 128 to get a nice-looking 4-digit score for all artists varying from 2500 to 9000+. This numerical value have no other meaning than classifying artist in top. Do not consider that an artist with score 8000 points is two times better than an artist with score 4000.

Feb 20

HDB flats size 1960-2010 analysis: are the flats shrinking?

Ministry of National Development, Khaw Boon Wan, said in 2012 that HDB flats have been the same size for last 15 years and are not shrinking. This article has been copied on numerous blogs.

As you can see in the following chat, the 4-room flats leased in 2000 were 90 sqm and 4-room flats launched in 2012 (TOP 2016) are the same 90 sqm, so he is not lying, instead he is masking the shrinking that occurred 15-20 years ago, also he does not take in consideration that the 4-room flat was the smallest flat type in 2000, while today it is the average flat type.

HDB flats size 1960s-2010s

HDB CEO, Dr Cheong Koon Hean, said that smaller flats do not mean lower quality of living, referring that family size decreased and square meter per person increased for 5-room flats, but exactly the table provided by him, shows that nationwide sqm per person is DECREASING, because in 1990s 3.9 people were living in 100-140 sqm flats, while today 3.4 people are crowding in 65-110 sqm only.

Also how the fuck the quality of living has not been lowered… if today’s 4/5-rm flats have master bedroom small as 4 x 3 meters (12 sqm) and common bedrooms 2.7 x 3 meters (8 sqm), even smaller in case of 2/3-rm flats, so we cannot put anymore a double bed, wardrobe and desk!? Since 1960s to mid-1990s, bedrooms were 12-16 sqm.

HDB household size versus flat size and living space per person

The truth about HDB flat sizes

The average size of each flat type was constant since 2000 onward but the overall average flat size has shrunk from about 120 sqm for flats leased in 1991-1996 to 78 sqm for BTO projects launched in 2010, due to phasing out the Executive flats and reintroducing the flats smaller than 4-room. After 2010 is started to rise: 81.8 sqm for 2011, 83.2 sqm for 2012 and 85.9 sqm for first half of 2013… thanks to increased supply of 5-room. Since mid-2013 HDB raised supply of 2-Room flats and allowed singles to purchase them, so the overall average flat size is going down again. Average size of all housing stock is around 95 sqm.

Today flats may appear even smaller, due to the household shelter introduced for all flats completed since 1998, and layouts with hallways to improve privacy in bedrooms.. However nowadays HDB flats are spaced more efficient than in 1990s, with kitchen and bedrooms being just enough size to fit specific furniture, saving space for a bigger room.

To see how HDB flats evolved in individual room sizes, look in HDB history & floor plans 1930-2010s.

The 1997 Asian Crisis left HDB with many unsold flats especially in larger flat types, however the decision to close the registration for Executive flats date back from 1995, they were built until 2004 to serve everyone in the queue. Due to the same reason, very few 5-Room were built during mid-2000s.

As the economy recovered, HDB reintroduced 5-room in 2008… let’s look on HDB website at applicant ratio, see how small flat types remain unsold, despite of cheaper price and higher grants, while the 5-Room get oversubscribed. There are couples without children applying for 4/5-Room flats not for having 3 bedrooms, but because they are unhappy by room sizes so choose a bigger flat to adjoin rooms and make a huge 2-room flat. People can afford bigger HDB flats!

There are rumors that HDB do not resume building Executive flats because the average household size dropped and most applicants are families up to 4 members, and the big flats are picked by rich people able to afford more space than they normally need. I can tell contrary, while running this website, I have been contacted by numerous people buying 5-Room BTO flats and complaining about impossibility to turn the study into a 4th bedroom for additional child, maid, in-laws, etc (possible in 1990s flats). While MND encourage raising birth rate, HDB offering flats with max 3 bedrooms, is discouraging us to make more than 2 children.

The 3gen flat introduced in 2013, having 4 bedrooms and restricted to a 3 applicants is welcome! Unfortunately it is only 115 sqm.

What do you prefer: to add Executive Apartments of 130 sqm, or to enlarge current 3/4/5-rm to 75/100/125 sqm?

Sick of HDB flat sizes?

Take a look how is the Housing around the World, especially in United Kingdom, Hong Kong, Japan, Brazil, etc… and realize that Singapore apartments are already one of the biggest in the world. The single country which exceed Singapore in terms of average apartment size and quality (and I love it!) is South Korea, having 3, 4, even 5 bedrooms, averaging 110 sqm. Korea passed in 1990s through a similar situation like Singapore, undersupply and rising prices. But they did not reduced apartment sizes, they built bigger and bigger and succeeded to keep prices stagnating and even decreasing (per square meter) last 20 years by building more than demand. Can’t understand why they need so many rooms.

I noticed a worldwide home sizes shrink around year 2000. Can be the innovations in technology responsible for this? For example: laptops replaced desktop computers, plasma TVs hanged on wall so you do not need anymore TV stand, and the kids no longer need space for toys because are playing in cyberspace?

But why I see so many Singaporeans complaining about flat sizes? Probably they never heard of versatile furniture, probably they have the Malay tradition with oversized houses, also HDB built too big and cheap flats in 1980s and 1990s, encouraging people to buy more than necessary and how to waste space. Chinese, indian, others.

In my opinion, the standard HDB size of 65 / 90 / 110 sqm is slightly acceptable, 75 / 100 / 125 sqm is the ideal, and most important, the average flat size should be 100 sqm.

But is totally unacceptable that private developers are building condos smaller than standard HDB sizes, and I am not talking about the 1-bedroom shoebox units, but about numerous private condos and EC offering 3-bedroom units which are less than 90 sqm, of which 10 sqm is balcony and 5 sqm A/C ledge, while bedrooms are small as 4-6 sqm. Most private units were in 100-200 sqm range until 1990s. URA should urgently regulate minimum apartment size! HDB also went under these standard sizes in case of Pinnacle @ Duxton and SkyVille / SkyTerrace @ Dawson.

How will look HDB of the future, with the current trend of private developers?

Page 5 of 13« First...34567...10...Last »