IMHOSTED A GREAT DESASTER PART 2

===========================

13. April 2009

===========================

(9:35:11) icq-number Happy easter
(9:35:25) icq-number we have major problems since yesterday with all sites on our account
(9:35:31) icq-number we dcan't do anything
(9:35:43) icq-number it seems that again somebody has changed PHP settings
(9:35:59) 242559147 Hi,may i know your domain name?
(9:36:03) icq-number fopen is activated on the ste again too
(9:36:05) icq-number domain2
(9:36:21) icq-number we weren't able to work already yesterday
(9:36:39) icq-number we can't even login with our passwords
(9:36:52) icq-number seems that some session stuff is corrupt in php
(9:37:16) icq-number Warning: Unknown: open(/domain-path/sessions/sess_8a68d16c3ebd34a9217a9cf28dab4bbb, O_RDWR) failed: Read-only file system (30) in Unknown on line 0

Warning: Unknown: Failed to write session data (files). Please verify that the current setting of session.save_path is correct (/domain-path/sessions) in Unknown on line 0
(9:37:18) 242559147 Please wait till i check the information for you.
(9:37:43) icq-number this is one of the sites all others are more or less the same and some show even more errors
(9:39:02) icq-number even files are 777 we get a read and write error
(9:39:22) icq-number and temp_ files get written with 99 99
(9:39:39) 242559147 The server is taken down for maintainance.Please try accessing your site after sometime.
(9:39:51) 242559147 We are sorry for the inconvenience caused.
(9:40:00) icq-number what does it mean after some time
(9:40:11) icq-number we need to work here it is alreay 10 am here
(9:40:21) icq-number when will the server work again
(9:40:26) icq-number 99% uptime ;-)
(9:40:54) icq-number please give us a time so we can send our staff home and don't need to pay them
(9:41:52) 242559147 We are extremely sorry for the inconvenience caused to you so far
(9:41:52) icq-number strange I can still access the server - how can you say its offline
(9:42:55) 242559147 There are some technical difficulties with the server
(9:43:14) icq-number Failed to write session data (files). Please verify that the current setting of session.save_path is correct (/domain-path/sessions) in Unknown on line 0
(9:43:25) icq-number here is the problem - it is your session stuff
(9:43:39) icq-number the path is incorrect
(9:44:07) 242559147 There is a problem with the filesystem on the server, our engineers are working on it at the moment.
(9:44:31) 242559147 Once the server is back online, you will be able to work with your application
(9:44:53) 242559147 Server might go down for maintenance in a while, please be patient.
(9:45:20) icq-number The sessions folder has only read only too
(9:45:23) icq-number yeah ok
(9:45:33) icq-number how long will it take
(9:46:29) 242559147 We have informed our datacentre and they'll do the needful.
(9:46:45) icq-number yeah but how long will it take
(9:46:52) icq-number so we can replane our tasks
(9:48:18) 242559147 It might take 30mins - 2 hours.
(9:48:24) icq-number ok hx
(9:48:35) 242559147 However we are still in touch with DC
(9:48:58) icq-number washington, Obama wow
(9:49:25) icq-number hopefuly no water from the portugese waterdog in your harddrives
(9:50:02) icq-number It is a very nice dog I like it
(9:50:14) icq-number never heard of it before
(14:21:47) icq-number Hi we are waiting meanwhile 5 hours and still the server and all our sites are not running
(14:21:52) icq-number what's up
(14:31:37) icq-number Hi somebody there?
(14:31:46) 242559147 Hi
(14:31:49) icq-number when is the server again running
(14:31:55) 242559147 We are sorry for the inconvenience caused.
(14:31:56) icq-number we are down now over 5 hours
(14:32:05) icq-number costs a lot money
(14:32:11) icq-number what is broken
(14:32:15) icq-number how long will it take
(14:32:29) 242559147 There are some technical issues with the server which our engineers are taking care of.
(14:32:44) icq-number You already said this 5 hours ago
(14:32:51) 242559147 we request your patience.
(14:33:41) icq-number as a bonus you should upgrade the customers from this server to the newest webspace sizes and benefits
(14:35:17) icq-number we still have only a small 200GB size
(14:35:18) icq-number http://imhosted.com/hosting_plans.shtml
(14:35:36) icq-number this would be a bonus for all the trouble at easter
(14:35:45) icq-number unlimited everything
(14:37:01) icq-number think about it and please let us know as we can't work and are loosing customers and money because of the inconvenience imhosted is causing - and was already causing nearly every month in our account - check our support history "domain2"
(14:37:05) icq-number domain.tld
(17:12:16) icq-number NOT WORKING

domain.tld loads at domain.tld/typo3/install
but our website itself NOT
http://domain.tld
or the backend
http://domain.tld/typo3

it seems the database server or the connection to it isn't working as the install tool does not need the database server - please check it

Andi
(17:12:51) icq-number The current username, password or host was not accepted when the connection to the database was attempted to be established!

Database Error
(17:13:27) icq-number at domain.tld you will get
(17:13:28) icq-number Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 821

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /domain-path/a8/domain2/typo3conf/ext/de_timezone/pi1/class.tx_detimezone_pi1.php on line 98

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 821

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 821

Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834
(17:13:40) 242559147 The server is facing some issues
(17:13:52) 242559147 Our senior techs are working on it
(17:14:02) icq-number support@imhosted.com to ab.becker
show details 4:57 PM (16 minutes ago)

Reply

The issue has been fixed, please check now.

James
Technical Analyst
(17:14:19) icq-number They wrote that they have FIXEDit already - but this is NOT the case
(17:14:44) icq-number we are waiting for a running server since 7am now we have already 17:14
(17:14:55) icq-number 10 hours waiting and still no solution
(17:15:37) icq-number Server is offline again
(17:16:19) 242559147 Sorry again
(17:16:27) icq-number yep
(17:16:31) 242559147 It will be fine shortly
(17:16:47) icq-number we hope so as some of our employees now finish there workday
(17:17:07) icq-number and the new shift is coming
(17:50:02) icq-number Here are our sites which worked ALL perfect before the clash and before you messed up again with fopen and openbase dir

ALL had no error messages and all sites where NOT edited since the server went down - because we were not able to access the server at all

Here all sites which should all work perfect

http://domain.tld
http://domain.tld/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://domain.tld/typo3/install

--------

http://demo.domain.tld/
http://demo.domain.tld/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://demo.domain.tld/typo3/install

--------

http://test.domain.tld/
http://test.domain.tld/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://test.domain.tld/typo3/install

--------

http://sub2.domain.tld/
http://sub2.domain.tld/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://sub2.domain.tld/typo3/install

--------

http://sub1.domain-path1/
http://sub1.domain-path1/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://sub1.domain-path1/typo3/install

--------

http://sub3.domain-path1/
http://sub3.domain-path1/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://sub3.domain-path1/typo3/install

--------

http://sub3.domain-path1/
http://sub3.domain-path1/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://sub3.domain-path1/typo3/install

--------

http://domain.tld/
http://domain.tld/typo3 (login and see if database loads or it gives wrong password error - right now it shows that no database is connected)
http://domain.tld/typo3/install

--------

http://domain.tld/jobs

http://domain.tld/live

http://domain.tld/martina

-------

There are several other sites as we have quite many but I don't remember their URLs now but you can see them in the tree and also in our MySQL

-------

Beside this it is NOT possible to connect via filezilla FTP or SFTP or via Putty SSH

Cpanel is also NOT working!!!
Oops! This link appears broken.
Suggestions:
Go to domain.tld
Search domain.tld for cpanel
Search on Google:
(17:50:29) icq-number support@imhosted.com to ab.becker
show details 5:32 PM (17 minutes ago)

Reply

Your sites are well accessible here, please check it once again from your end. If you're still unable to browse it, please let us know. Do provide us the error message if any, in that case.

James
Technical Analyst
(17:50:48) icq-number Don't k now what he is actually checking but here we see absolut NO PROGRESS
(17:50:51) icq-number at all
(17:51:43) icq-number Waiting to retry...
Status: Resolving address of domain.tld
Status: Connecting to 207.210.103.242:21...
Error: Connection timed out
Error: Could not connect to server
(18:24:19) icq-number We still can't access any of our sites or ftp or ssh
(18:25:05) icq-number Connection timed out
Error: Could not connect to server
Status: Resolving address of domain.tld
Status: Connecting to 207.210.103.242:21...
Error: Connection timed out
Error: Could not connect to server
Status: Waiting to retry...
(19:21:08) icq-number http://72.14.235.132/search?q=cache:http://domain.tld/
(19:21:35) icq-number Hi DIJO when will our site be BACK - OUR SITES and complete account with lots of sites
(19:21:47) icq-number we are already waiting now over 12 hours
(19:21:56) icq-number No 99.9% uptime
(19:22:02) icq-number nothing accessible
(19:22:11) icq-number no responses from imhosted
(19:22:18) icq-number are you there?
(19:23:31) icq-number Only to let you know we had today a loss of 3 contracts with good customers
(19:24:05) icq-number We still had them after you promised to have the site back after 2 hours this morning but after 5 they got angry and after 10 they cancelled
(19:24:29) icq-number even we told them that it is NOT a Thai Problem but an AMERICAN One
(19:24:53) 242559147 We are really sorry
(19:24:55) icq-number and we can't do anything than wait. - they said they have no time to wait
(19:25:03) 242559147 /home2 of the server is undergoing fsck
(19:25:30) 242559147 Our Data center engineers are working on it
(19:25:32) icq-number yeah fine - this means for us setting a complete team free next week for the following months
(19:25:41) icq-number 4 people
(19:26:01) icq-number they are not happy at all, but we have no other choice. They came last they go first
(19:26:09) icq-number as we have no money to pay them
(19:26:19) icq-number because we losse the contracts
(19:26:42) 242559147 I can uderstand your frustration
(19:27:02) icq-number It is same situation like 2006 where imhosted was down for days
(21:15:37) 242559147 Hello
(21:15:54) icq-number hi so how far are you
(21:16:14) 242559147 the server is getting Up now
(21:16:34) icq-number not here
(21:16:37) icq-number still nothing
(21:17:20) 242559147 please wait for some more time
(21:17:32) icq-number yeah waiting
(21:21:47) 242559147 Did you check ?
(21:22:12) icq-number yeah was nothing
(21:22:30) icq-number turning turning turning around
(21:22:40) icq-number I am using Chrome
(21:22:48) icq-number but nothing is happening
(21:22:53) icq-number same filezilla
(21:23:15) icq-number Warning: mysql_fetch_assoc(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 834

Warning: mysql_free_result(): supplied argument is not a valid MySQL result resource in /domain-path/typo3/typo3_src-4.3.0alpha2/t3lib/class.t3lib_db.php on line 861

Error!

No TypoScript template found!
(21:23:23) icq-number Database is still not connected
(21:23:57) 242559147 Ok..hold on
(21:26:18) 242559147 Which link you are trying to access ?
(21:26:27) icq-number our main domain
(21:26:30) icq-number domain.tld
(21:26:40) icq-number If this is working I will access all others
(21:26:44) icq-number afterwards
(21:26:51) icq-number nightshift as I guess
(21:27:16) 242559147 It is loading fine now
(21:27:41) 242559147 Please clear your browser cache and try again
(21:27:43) icq-number I try backend
(21:27:57) 242559147 Or check with any other web browser
(21:28:50) icq-number Here I have still this session problem like before your server clashed
(21:28:51) icq-number Login-error or session timed-out

No user logged in! Sorry, I can't proceed then!

(You must have cookies enabled!)

If your session has just timed-out, you may
click here to re-login.
(21:29:13) icq-number it is caused by some php settings
(21:33:51) icq-number The temporary files get created as 99 99 why?
(21:36:13) icq-number we get logged in but logged out immediately again
(21:43:33) icq-number On zz.domain.tld/typo3/backend.php we get Fatal error: Cannot run code from this file in conjunction with non encoded files in /domain-path/a2/yaml/typo3/sysext/viewpage/view/conf.php on line 392
(21:45:08) icq-number when we click many times arrythmic to rload the page than it works and we get into the backend of sub2.domain.tld - It seems that some files are not read correctly - similar to a harddrive which is broken
(21:45:25) 242559147 Can you please post a ticket regarding this issue
(21:46:03) icq-number I had already days ago as now the site behaves like before - we can't login in most of our sites
(21:47:54) icq-number Now e get again This webpage is not available.

The webpage at http://sub2.domain.tld/typo3/backend.php might be temporarily down or it may have moved permanently to a new web address.
(21:48:07) icq-number Error 324 (net::ERR_EMPTY_RESPONSE): Unknown error.
(21:49:24) icq-number THis seems to be the rror source
(21:49:25) icq-number Fatal error: Cannot run code from this file in conjunction with non encoded files
(21:50:05) icq-number why is this happening as i.e. at sub2.domain.tld it is a site which runs on hundrets of servers - it is the TYPO3 YAML Demo
(21:50:11) icq-number so at least this should work
(21:50:30) icq-number I will be back in 1 hour as I have a client now.
(21:51:26) icq-number Please check if you do some additional encoding somewhere as we have no idea where this encoding comes from - looks like you have a new cache optiizer installed which conflicts here
(23:30:22) icq-number As you can see here http://domain.tld/jobs/

Fatal error: Cannot run code from this file in conjunction with non encoded files in /domain-path/a8/jobberbase/jobs/_templates/_cache/%%E5^E51^E51533DF%%loops.tpl.php on line 1861