Ilo 4 has detected a self test error как исправить

У одного из наших клиентов, которому мы оказываем услуги ИТ аутсорсинга , на сервере HPE Proliant Gen8 периодически стала сбоить дисковая подсистема, построенная на отказоустойчивой технологии raid5. Анализ ситуации показал, что причина сбоев кроется в жестких дисках. На протяжении четырёх лет они работали постоянно, с высокой нагрузкой (сервер выполнял роль базы данных 1с Предприятие). На дисках стали появляться сбойные секторы, из-за чего рейд-контроллер начал часто выполнять проверку целостности. Менять диски по одиночке мы не стали, было принято решение создать массив из новых дисков с полной переустановкой Windows Сервер (тем более, что за это время вышла его новая версия). Все операции для нас — весьма обыденные и сюрприза никто не ждал.

Сделали резервные копии всех ценных данных, которые также остались на старом массиве. Достали старые диски из сервера и установили новые. Далее предстояло создать новый рейд-массив. Для этого нужно было после включения сервера зайти в фирменную утилиту HPE Intelligent Provisioning .

Каково было наше удивление, когда при попытке запуска Intelligent Provisioning на мониторе был только чёрный экран.

Сначала мы предположили, что версия Intelligent Provisioning устарела и не хочет загружаться, т.к. в процессе эксплуатации сервера мы обновляли только важные драйверы и систему HPE Integrated Lights-Out v4 (iLO) из-за найденных в ней уязвимостей. Решили обновить всё. Скачали последнюю версию образа HPE Service Pack for ProLiant (SPP) Gen8 , которая доступна нам как партнерам HP, запустили, обновили всё, что нашлось нового. Но, к сожалению, там не было ничего про обновление HPE Intelligent Provisioning. После рестарта сервера она всё ещё не запускалась.

Погуглили и выяснили, что нам, вероятно, поможет другая утилита, под названием Intelligent Provisioning Recovery Media . По информации с сайта HP — она может восстановить и обновить Intelligent Provisioning на сервере.

Смонтировали образ через iLO и загрузили. В процессе запуска получили вот такое сообщение: BMC unresponsive unable to continue . Обновление HPE Intelligent Provisioning не загружается.

» data-image-caption=»» data-medium-file=»https://rexar.ru/wp-content/uploads/2018/03/IMG_20180216_121902.jpg» data-large-file=»https://rexar.ru/wp-content/uploads/2018/03/IMG_20180216_121902.jpg» decoding=»async» title=»BMC unresponsive unable to continue» src=»https://rexar.ru/wp-content/uploads/2018/03/IMG_20180216_121902.jpg» alt=»BMC unresponsive unable to continue» width=»800″ height=»506″/>

Почитали инструкцию, там написано что образ через iLO лучше не монтировать, т.к. в процессе обновления он может отвалиться. В сервере нет DVD привода, а у нас чистых болванок. Проблема. Потратили время, добыли всё что надо. Загрузились с DVD и опять получили ошибку BMC unresponsive unable to continue. Проблема была не в образе.

В процессе гугления и множественных перезагрузок сервера заметили, что iLO как-то ненормально подтормаживает, но не обратили внимания. Далее, в процессе загрузки сервера, заметили неприметную надпись: iLO self test error , которая очень быстро исчезала. Решили, что с iLO что-то не так, заново перезалили последнюю прошивку, но надпись не исчезла. Снова погуглили, и обнаружили информацию о том, что из-за сбоя в NAND памяти iLO, журналы HPE Active Health System (AHS) и профили HPE OneView становятся недоступны, что приводит к ошибке самотестирования iLO self test error. Это и является причиной заторможенной работы, которую мы наблюдали ранее. Ну и конечно, Intelligent Provisioning не будет работать при нажатии клавиши F10. БИНГО!

В качестве решения предлагается отформатировать эту самую NAND память. Для этого создаём файл Format.xml такого содержания:

[pastacode lang=»markup» manual=»%3CRIBCL%20VERSION%3D%E2%80%9D2.0%E2%80%B3%3E%0A%3CLOGIN%20USER_LOGIN%3D%E2%80%9DAdministrator%E2%80%9D%20PASSWORD%3D%E2%80%9D%E2%80%9D%3E%0A%3CRIB_INFO%20MODE%3D%E2%80%9Dwrite%E2%80%9D%3E%0A%3CFORCE_FORMAT%20VALUE%3D%E2%80%9Dall%E2%80%9D%20%2F%3E%0A%3C%2FRIB_INFO%3E%0A%3C%2FLOGIN%3E%0A%3C%2FRIBCL%3E» message=»» highlight=»» provider=»manual»/]

и запускаем его через фирменную утилиту, конфигурирования iLO

hpqlocfg -s -l c:temphpqcfg.log -f c:tempFormat.xml -v -t user=Administrator,password=

Указывать необходимо те логины и пароли, которые предоставляют полный доступ к iLO.

После выполнения скрипта iLO перезагрузится и заново инициализирует NAND память.

Ждем 5 минут, запускаем Intelligent Provisioning, старая версия загрузилась нормально. Ну, гулять так гулять — убили кучу времени, можно и обновить и Intelligent Provisioning до новейшей версии.

Запускаем управление рейд-контроллером, делаем пятый рейд, устанавливаем Windows.

В завершение устанавливаем драйверы, обновления, SQL сервер, 1с предприятие, делаем настройки на максимальную производительность.

Источник

What is the NAND used for in the HPE ProLiant DL360p Gen8?

I have a server with the error: ‘iLO Self-Test reports a problem with: Embedded Flash/SD-CARD’ ‘ Embedded media manager failed initialization ‘

I’ve now reached the step of all steps, replace the system board. But I’m wondering what the impact would be if I would not replace the board. I do not use the SD-CARD. I’m not sure what the NAND actually is used for and what it stores, and further more what do I risk if I do not resolve this issue?

I believe it might be loss of logs from the iLO and perhaps even loss of settings from the iLO?

Edit, it is now months later, servers still out of warranty, even found more similar issues with NAND which all fit under this HPE Advisory umbrella. Using the RESTful Interface Tool solves annoying problems with hands on support for the AC power removal part. But sadly I still can’t fix all issues. While I’ve seen some information, in this thread, online and the like. I can’t find any conclusive information from HPE what the impact is for NAND issues like this.

5 Answers 5

There isn’t too much you can do about this.

Please run the normal firmware updates on the host either via Intelligent Provisioning or the HP SPP bootable DVD.

But since Gen8 systems are end-of-life, there isn’t much incentive for HPE to deal with this issue. I’ve seen this in about 5% of Gen8 servers still in the field.

This should not impact the usability of the server, though.

There is actually a procedure described by HP to correct the problem with the embedded NAND Flash. We had the same problem and the procedure described in the advisory has corrected the error. After the NAND flash format our server needed a power off and a disconnect from the main power supply. After the following boot the iLO Health was o.k.

The NAND is used for:

From the HP doc «NAND Usage in Gen8 Through Gen10 Plus HPE Servers»:

A NAND with too many worn out cells is considered worn out. A worn out NAND in an HPE server can lead to the following:

• Inability to manage the server with HPE OneView.
• Inability to download the AHS log.
• Sluggish iLO GUI interaction.
• POST errors during system boot.
• Inability to use Intelligent Provisioning to configure the server or deploy an operating system.
• Timeout of remote commands to iLO (impacting automation developed by customers).

A worn out NAND will not normally impact a server in production, except for servers managed by HPE OneView. If the NAND is worn and the server is already under HPE OneView management there will not be an immediate impact. There may be errors and the profile cannot be modified. In addition, the server cannot be brought under HPE OneView management and a server profile cannot be applied.

Source: «NAND Usage in Gen8 Through Gen10 Plus HPE Servers» https://psnow.ext.hpe.com/doc/a00060052en_us

We have a couple of DL360 G8 servers with this NAND issue. The major problem is that they boot from SD (Firewall appliances) and when this issue appears the whole SD becomes read only which creates problems as the states and configs are not saved, nor can you update anything. Reformatting the NAND flash and resetting the E-Fuse does not resolve the problem. I was told the NOR NAND flash is the N25Q064 (64Mbit) 8 pin SO chip labeled U163 on the motherboard (nope, that’s the system BIOS, check the update below!) near the riser and slot 2 of the PCI-E x16.

Источник

What is the NAND used for in the HPE ProLiant DL360p Gen8?

I have a server with the error: ‘iLO Self-Test reports a problem with: Embedded Flash/SD-CARD’ ‘ Embedded media manager failed initialization ‘

I’ve now reached the step of all steps, replace the system board. But I’m wondering what the impact would be if I would not replace the board. I do not use the SD-CARD. I’m not sure what the NAND actually is used for and what it stores, and further more what do I risk if I do not resolve this issue?

I believe it might be loss of logs from the iLO and perhaps even loss of settings from the iLO?

Edit, it is now months later, servers still out of warranty, even found more similar issues with NAND which all fit under this HPE Advisory umbrella. Using the RESTful Interface Tool solves annoying problems with hands on support for the AC power removal part. But sadly I still can’t fix all issues. While I’ve seen some information, in this thread, online and the like. I can’t find any conclusive information from HPE what the impact is for NAND issues like this.

5 Answers 5

There isn’t too much you can do about this.

Please run the normal firmware updates on the host either via Intelligent Provisioning or the HP SPP bootable DVD.

But since Gen8 systems are end-of-life, there isn’t much incentive for HPE to deal with this issue. I’ve seen this in about 5% of Gen8 servers still in the field.

This should not impact the usability of the server, though.

There is actually a procedure described by HP to correct the problem with the embedded NAND Flash. We had the same problem and the procedure described in the advisory has corrected the error. After the NAND flash format our server needed a power off and a disconnect from the main power supply. After the following boot the iLO Health was o.k.

The NAND is used for:

From the HP doc «NAND Usage in Gen8 Through Gen10 Plus HPE Servers»:

A NAND with too many worn out cells is considered worn out. A worn out NAND in an HPE server can lead to the following:

• Inability to manage the server with HPE OneView.
• Inability to download the AHS log.
• Sluggish iLO GUI interaction.
• POST errors during system boot.
• Inability to use Intelligent Provisioning to configure the server or deploy an operating system.
• Timeout of remote commands to iLO (impacting automation developed by customers).

A worn out NAND will not normally impact a server in production, except for servers managed by HPE OneView. If the NAND is worn and the server is already under HPE OneView management there will not be an immediate impact. There may be errors and the profile cannot be modified. In addition, the server cannot be brought under HPE OneView management and a server profile cannot be applied.

Source: «NAND Usage in Gen8 Through Gen10 Plus HPE Servers» https://psnow.ext.hpe.com/doc/a00060052en_us

We have a couple of DL360 G8 servers with this NAND issue. The major problem is that they boot from SD (Firewall appliances) and when this issue appears the whole SD becomes read only which creates problems as the states and configs are not saved, nor can you update anything. Reformatting the NAND flash and resetting the E-Fuse does not resolve the problem. I was told the NOR NAND flash is the N25Q064 (64Mbit) 8 pin SO chip labeled U163 on the motherboard (nope, that’s the system BIOS, check the update below!) near the riser and slot 2 of the PCI-E x16.

Источник

HPE ILO4 Embedded Flash error

iLO Self-Test reports a problem with: Embedded Flash/SD-CARD. View details on Diagnostics page

ILO Version 2.73

I’ve tried resetting ILO nd this fixes it temporarily

Ultimate Solution is an IT service provider.

Popular Topics in HP Hardware

I’ve seen the same issue as SherwynB ​ on at least four DL380P Gen8’s. I believe there was an issue with early revisions of the ILO firmware that was later corrected, and part of the procedure was to reformat the NAND. If you’re still having issues following that (and you’re at a good revision of ILO firmware already) you’ll need a systemboard replacement, unfortunately.

• local_offer Tagged Items
• SherwynB

Ultimate Solution is an IT service provider.

Unless you have installed a SD/Flash card in the server then this is the expected behaviour. If you have one installed then check that it is working properly in another computer and is not write protected (unless your specific requirements are a read only SD card)

If this for a Gen 8 then you’re probably out of luck and will need to replace the motherboard. There are a few things you could try like doing a NAND flash (which might work in fixing your issue). There is some info about the problem online. I am unfortunately in the same situation with a Gen 8 Microserver as the Intelligent Provisioning wasn’t working and i didn’t know why.

I’ve seen the same issue as SherwynB ​ on at least four DL380P Gen8’s. I believe there was an issue with early revisions of the ILO firmware that was later corrected, and part of the procedure was to reformat the NAND. If you’re still having issues following that (and you’re at a good revision of ILO firmware already) you’ll need a systemboard replacement, unfortunately.

• local_offer Tagged Items
• SherwynB

Yep, DL380p Gen8 here with the same issue. In my case this also affects the ability to generate AHS logs.

This topic has been locked by an administrator and is no longer open for commenting.

To continue this discussion, please ask a new question.

Read these next.

poor wifi, school’s third floor

I work as a help desk technician at a high school for a school district. Teachers/students on the building’s third floor have been reporting poor wifi, with their Chromebooks/laptops etc experiencing slow connectivity and random disconnections. We hav.

Need help crafting a job posting for an IT Pro

I’d really appreciate some thoughts and advice. I’m looking to hire an IT pro to be our resident go-to for all things IT (device support, SQL Server, network admin, etc) but who also is interested in learning — or even has some experience in — the.

Snap! — AI Eye Contact, Mine Batteries, Headset-free Metaverse, D&D Betrayal

Your daily dose of tech news, in brief. Welcome to the Snap! Flashback: January 13, 1874: Adding Machine Patented (Read more HERE.) Bonus Flashback: January 13, 1990: Astronauts awakened to the song Attack of the Killer Tomatoes (Read mor.

Spark! Pro series – 13th January 2023

Happy Friday the 13th! This day has a reputation for being unlucky, but I hope that you’ll be able to turn that around and have a great day full of good luck and good fortune. Whether you’re superstitious or not, .

Источник

media

iLO 4 has detected a self test error. For details consult the iLO 4 server and iLO 4 diagnostics page

Embedded Flash/SD-CARD: Embedded media manager failed media attach. 

frame.on('open',function() {
  var selection = frame.state().get('selection');
  var ids_value = jQuery('#my_field_id').val();

  if(ids_value.length > 0) {
    var ids = ids_value.split(',');

    ids.forEach(function(id) {
      attachment = wp.media.attachment(id);
      attachment.fetch();
      selection.add(attachment ? [attachment] : []);
    });
  }
});