Web Analytics Made Easy -
StatCounter

India car database changelog

In 2015 about 8% of website traffic was from India, every year dozens of Indians ask me if I can make an automobile database for their country. For long time I stayed away from doing this, for 3 reasons:
– Lack of reliable data source comparable with AutoKatalog magazine (Europe) and Edmunds.com website (America).
– The poverty of a third-world country (some customers offered me sums of money that makes me crying).
– The bad experience with some Indians, many people ask what they need but only a small fraction of them are actually willing to pay, difficult to estimate market size, easy to overestimate sale potential, also aggressive attitude and putting me to do the work for free and pay afterwards only “if they like the work”, sometimes asking me to do unwanted work out of my experience field, made me undecided if I should serve anyone in India.

Copy-pasting data from websites would have required dozens of hours, too much effort for the offers received, alternatively could pay a programmer to scrap data automatically from a website, but with the little sums of money offered by potential customers, had to do at least 10-20 sales to be able to cover the cost (freelance programmers charge few hundred dollars for scraping services).

The decision to build an Indian car database came in August 2015, after finishing a new phase in development of European databases that kept me busy between 25 July and 15 August, got some free time and I learned to scrap data from websites myself, this can reduce significantly the amount of time investment needed to create the India car database, reaching the line of profit. As coincidence, Carwale website was redesigned between 14 or 18 August 2015 according www.archive.org.

In just one week, been contacted by 3 new potential customers asking for a list of cars in India. 2 of them insisting to scrap data from a website and one was against automated scraping. If you’re against scraping please suggest an alternate way to get the data!

Cars list of updates

~500 models, 2855 versions (998 in production), ~1000 KB – 25 August 2015 (25 columns). 3 eurocents/model = 85.65 euro.
Dimensions database: 3 eurocents/model / dimensions (6 columns).

~500 models, 2904 versions (partial update), 5393 KB – 28 October 2015 (176 columns).

528 models, 3121 versions (1044 in production), 5969 KB – 22 December 2015 (178 columns), 4 eurocents/model = 124.84 euro.
After 3rd sale I re-launch database in 4 formats: Make & Model (310 models), Dimensions (515 models), Basic Specs (2 eurocents/model), Full Specs & Features (4 eurocents/model).

549 models, 3214 versions, unreleased – 1 February 2016.

557 models, 3254 versions, unreleased – 1 March 2016.

547 models, 3290 versions (1078 in production), 6474 KB – 14 March 2016 (179 columns), 4 eurocents/model = 131.60 euro.

561 models, 3303 versions, unreleased – 1 April 2016.

564 models, 3354 versions, unreleased – 1 May 2016.

569 models, 3404 versions (1045 in production), 6556 KB – 1 June 2016.
Price capped at 120 euro, no further increases.

574 models, 3432 versions (1098 in production), 6877 KB – 1 July 2016.
Make & Model 319 models, Dimensions 472 models. Added ID column.

576 models, 3469 versions (1082 in production), 7312 KB – 1 August 2016 (183 columns).
Basic specs and No specs now include also prices. Status (production/discontinued) column removed because prices do this job.

579 models, 3509 versions (1101 in production), 7414 KB – 1 September 2016.

582 models, 3555 versions (1100 in production), 7125 KB (except colors) – 1 October 2016.

596 models, 3615 versions (1118 in production), 7634 KB – 1 November 2016 (186 columns).
Status column added back, prices removed from No specs. Image URL added. One customer told me to scrap an used cars website and by this way I found additional makes, discontinued, missed from my database: Mahindra-Renault (Logan and Sandero models that aren’t listed on either Mahindra or Renault), also Chrysler, Maini, Maybach, Willys, total 9 models, 50 versions.

605 models, 3661 versions (1115 in production), 7769 KB – 1 December 2016.

610 models, 3680 versions (1128 in production), 7824 KB – 1 January 2017 (188 columns).
Added car class and body style, two columns added in October as custom package for a specific customer, now they are offered to all customers.
No specs (5 columns) 505 KB, Basic specs (26 columns) 1357 KB.
Dimensions 535 models (10 columns) 169 KB, added car class and body style.
Make & Model 353 models (4 columns) 76 KB, added status and car class.

613 models, 3725 versions (1165 in production), 8002 KB – 1 February 2017.

619 models, 3795 versions (1147 in production), 8084 KB – 4 March 2017.

3843 versions (1155 in production), 8505 KB – 1 April 2017.

3945 versions (1122 in production), 9004 KB – 1 May 2017. URL column added.

3955 versions (1145 in production), 9315 KB – 2 June 2017. Some changes in the source website caused file size increase.

3980 versions (1140 in production), 9108 KB – 1 July 2017.

4016 versions (1144 in production), 9236 KB – 1 August 2017.

4062 versions (1168 in production), 9605 KB – 1 September 2017.

4097 versions (1179 in production), 9670 KB – 1 October 2017.

4144 versions (1192 in production), 10251 KB – 1 November 2017.

4181 versions (1161 in production), 10397 KB – 1 December 2017.

4218 versions (1180 in production), 11371 KB – 1 January 2018.

4246 versions (1134 in production), ???? KB – 1 February 2018.

4274 versions (1127 in production), 11544 KB – 1 March 2018.

4296 versions (1125 in production), 11596 KB – 1 April 2018.

4332 versions (1146 in production), 11702 KB – 1 May 2018.

4372 versions (1141 in production), 11832 KB – 1 June 2018.

4401 versions (1139 in production), 11884 KB – 1 July 2018.

4418 versions (1135 in production), 11939 KB – 1 August 2018.

4480 versions (1145 in production), ? KB – 1 September 2018.

4511 versions (1160 in production), ? KB – 1 October 2018.

4562 versions (1168 in production), ? KB – 1 November 2018.

4616 versions (1176 in production), ? KB – 1 December 2018.

4639 versions (1180 in production), 12663 KB – 1 January 2019.

4683 versions (1178 in production), ? KB – 1 February 2019.

4721 versions (1177 in production), ? KB – 1 March 2019.

4756 versions (1168 in production), 12982 KB – 1 April 2019.

4803 versions (1158 in production), 13137 KB – 1 May 2019.

4850 versions (1171 in production), 13271 KB – 1 June 2019.

4900 versions (1214 in production), 13431 KB – 1 July 2019.

4929 versions (1172 in production), ? KB – 1 August 2019.

4983 versions (1200 in production), ? KB – 1 September 2019.

5038 versions (1225 in production), 13782 KB – 12 October 2019.

Accuracy notes

There may be errors, at least in car dimensions, I have seen some cars have width over 2m because mirrors are included while other cars do not include mirrors, I can correct some cars but in case of other cars I would not know the correct values. When comparing apparently correct dimensions with my European database, some numbers differ by few mm.

Same errors do exist on at least 3 websites (Carwale, Cardekho, Cartrade), so I guess that they sourced data from same common source, meaning that you can use same data on your own website without risk of lawsuit.

Bikes list of updates

24 makes, 247 models – January 2016 (initial release).

25 makes, 271 models – October 2016.

Somewhere in 2017 I discovered that Bikewale have links to discontinued models, this increased model count to over 600. I did 2 more updates in 2017 but did not tracked them.

27 makes, 647 models, specs for 426 models – April 2018.

36 makes, 782 models, 1214 versions, specs available for 927 models – 4 April 2019.

41 makes, 845 models, 1219 versions – 13 October 2019.

Leave a Reply

Your email address will not be published.