Announcement

Collapse
No announcement yet.

Convert crash with large output file using mp4 h265

Collapse
X
Collapse
 
  • Page of 2
  • Filter
  • Time
  • Show
Clear All
new posts
Previous 1 2 template Next
    #1

    Convert crash with large output file using mp4 h265

    When I try to encode a large file, the encoding process crashes about 8 or 9GB leaving the following exception std_exception(bad allocation).

    Looks like it hits the limit of what a 32 bit process can do in this case.

    ------ process working ------
    0m 00.09s: info, try to open file C:/Users/Frédéric/Downloads/DVDFab/Into the Universe - S1E3 - The Story of Everything.m4v
    0m 00.19s: info: open successed, iformat = QuickTime / MOV
    0m 00.19s: info: create config(videoconvert)
    0m 00.19s: info: crop value after clone: left = 0 right= 0 top=0 bottom=0 enable=0 mode=0
    0m 00.19s: info: use profile(MP4.H265)
    0m 00.19s: info: file (.m4v)
    0m 00.19s: info: 3D working_mode(disable), 3D format(sbs_lef_right)
    28m 34.85s: UILog:MsgWork:WorkStatus_Start
    0m 00.20s: info: stream input@ Video(1)[codec(h264) size(1920*1080) fps(30000/1001) interlace(1) duration(5206)sec opcode(compress)]
    0m 00.20s: info: perset file config OK !
    0m 00.20s: info: set output video frame_rate(30000/1001)
    0m 00.20s: info: recommand= 0, Shrink support= 0, enable= 0, cuda_cap= 0 , cpu_count= 8
    0m 00.20s: info: stream output Video(1)[codec(hevc) size(1920*1080) fps(30000/1001) interlace(1) bitrate(13362) duration(5206)sec]
    0m 00.21s: info: stream input@ Audio(2)[codec(aac) channels(6) sample(48000) bitrate(186460) bitdepth(16) opcode(copy)]
    0m 00.21s: info: stream output Audio(2)[codec(aac) channels(6) sample(48000) bitrate(186460) bitdepth(16) opcode(copy)]
    0m 00.21s: info: SubMode(Render) -- Display Only forced Subtitle(false)
    0m 00.21s: info: enable multi-thread software decoder, thread count = 8
    28m 34.86s: UILog:MsgWork:WorkStatus_Start
    0m 00.36s: info: h264_encode: encode param profile(1) level(40) bitrate(13362) crf(-1)
    264m 50.74s: UILog:OnMsgToolbar_Pause
    269m 23.74s: opening drive H
    269m 23.74s: DriveX msg: media open(false) failed in driveX H.
    269m 29.46s: DriveX msg: remove media in driveX H.
    269m 29.47s: DriveX msg: remove driveX H.
    269m 29.51s: Source managerpen source flag:1,0,1,1
    269m 29.52s: Source managerpen source flag:1,0,1,1
    282m 56.35s: UILog:OnMsgToolbar_Continue
    658m 59.22s: error: filter name(native_mux), type(128), id(12), get std_exception(bad allocation)
    Tags: None
    #2
    32 bit Windows/NTFS has a 2TB limit so the issue lies elsewhere. Make sure the hard drive is the target.
    How to post the internal log


    Things should be made as simple as possible, but no simpler.
    Albert Einstein

    Comment

      #3
      My 32bit comment refered to the the process FabCore.exe which is 32 bit.

      Meaning its allocatable memory is 2GB. It could be 4GB under windows 64bit, if the compile the IMAGE_FILE_LARGE_ADDRESS_AWARE flag was used at compile.

      What is likely to be happening here is that the virtual memory space gets fragmented. Making it impossible to allocate new large memory structures, since it can't find a free memory space large enough for it.

      Comment

        #4
        There enough space on the target hard drive which is format NTFS.

        Comment

          #5
          I think you may be confusing a 32 bit file allocation table with a 32 bit data bus.
          How to post the internal log


          Things should be made as simple as possible, but no simpler.
          Albert Einstein

          Comment

            #6
            I'm talking of neither.

            I'm talking about the Windows memory architecture.
            This article is explaining it in detail http://windoh.wordpress.com/2010/01/...-1-the-basics/

            Basically each process get assigned a virtual memory allocation table (4 GB for 32bit process, 16TB for 64bit process). The pointers in a program point toward that table. The Windows HAL (Hardware abstract layer) maps those adresses either to the physical memory or the paging file.

            So a 32bit process is effectively limited to 4GB of memory globally, regardless if it runs on Windows 64bit with 16GB of memory at it's disposition. The memory is further reduced by the original 32bit architecture splitting in 2 the adressable memory, 1 half for system use, the other half for the application data. So a 32bit program is limited to 2GB by default. The IMAGE_FILE_LARGE_ADDRESS_AWARE compilation flag changes that behavior. On a Windows 64bit, it gives the full 4GB for application data.

            Comment

              #7
              Did you try it with the normal MP4 264 profile?
              I really don't think H265 will give a better picture than h264 in this case and most hardware players can't play H265.Most software players will play audio only except for Fab media player and VLC player.

              Comment

                #8
                I haven't tried to do an encode into a mp4 h264.
                The file is already in that format and I have that I need to do this.

                As for support, the software I use does support the h265 decoding.
                I'm hoping to cut by 40% the space used by my library, which is roughly the size equivalence measured in the benchmarks I've read.

                From the pictures comparison I did myself, there is a little detail loss in the lower frequency details. Nothing you'd notice without a side by side comparison.

                That's actually quite different from h264, which cuts in the higher frequency details first.

                Comment

                  #9
                  Hi,

                  We did some improvments for H265 conversion in the latest beta version V9173.

                  Would you please try it again?

                  Wilson
                  Please post your logs the default location is:
                  For DVDFab 13: C:\Users\User Name\My Documents\DVDFab\DVDFab13\Log
                  For StreamFab: C:\Users\User Name\My Documents\DVDFab\StreamFab\log
                  Please use attachment button and attach your most recent, Internal log and post right here.
                  If it's the burning issue, please also attach burn log.

                  Thanks!

                  Comment

                    #10
                    I finished encoding my large video with 9.1.7.3 using h265 2 pass.
                    It did manage to encode the full file without crashing.
                    But instead on giving the requested 18644 kb/s, the end result was 30.1 mb/s. Almost the same as the original h264 file.

                    Code:
                    DVDFab 9.1.7.3 (2014/11/10  21:40:11)

 0m 00.07s: Init Public log : enabled.
 0m 00.07s: Init Private log : finish.
 0m 00.14s: App info: 2014-11-8
 0m 00.14s: App info: 9.1.7.3 9173 Beta
 0m 00.16s: Init CrashReportSettings : enabled.
 0m 00.31s: Init DVDInfo_Log : enabled.
 0m 00.31s: Init Qt_Log : disabled.
 0m 00.48s: Profile Manager :: Begin Load Profile 
 0m 00.48s: Qt Translator file load success 
 0m 00.50s: App info: client type 2.
 0m 00.53s: MobilePlay load: preload successful.
 0m 00.76s: MobilePlay load: Load successful.
 0m 00.76s: Init process: Transfer settings successful.
 0m 00.78s: info: check logpath= C:/Users/gosse_000/Documents/DVDFab9/Log/
 0m 00.81s: info: _check_gpu is running ...
 0m 01.57s: info: check_gpu run successful 
 0m 01.57s: info: recommand= 0, Shrink support= 0, enable= 0, cuda_cap= 0 , cpu_count= 8
 0m 01.58s: GPU check: GPUAccelerate-0
 0m 01.58s: GPU check: GPUAccelerate setting-0, 0
 0m 01.63s: GPU check: CUDA cap-0
 0m 01.63s: GPU check: Support coreavc decode-0
 0m 01.63s: GPU check: Lighting shrink status-0, 0
 0m 01.63s: GPU check: Graphics info 1: VMware SVGA 3D : 7.14.1.5026 : 
 0m 01.63s: Init process: Load config successful.
 0m 01.63s: Init process: Windows os type is 64bit System Windows 8.
 0m 01.66s: Init process: command line in is 
 0m 02.29s: Profile Manager :: End Load Profile 
 0m 02.53s: Reg check: Option check status-Failed
 0m 02.55s: Reg check: ( HD Decrypter:1:0 )-( DVD to DVD (Gold):0:0 )-( DVD to DVD:0:0 )-( DVD to Mobile:0:0 )-( Blu-ray to Blu-ray:0:0 )-( Blu-ray to Mobile:0:0 )-( File to Mobile:0:0 )-( Blu-ray to DVD:0:0 )-( DVD to Blu-ray:0:0 )-( File to DVD:0:0 )-( File to Blu-ray:0:0 )-( File Mover:1:0 )-( Blu-ray to 3D:0:0 )-( 2D to 3D:0:0 )-( Blu-ray Decrypt:1:0 )-( DVD Decrypt:1:0 )-
 0m 02.55s: App info: language type ENU.
 0m 02.55s: Reg check: Start get sys number.
 0m 02.58s: Reg check: Serial number is: b4-b6-76-d5-a3-b2:00-0c-29-5a-0a-1f
 0m 02.58s: Reg check: Connect type is: 0
 0m 04.38s: Reg check: Times of connecting error is: 0
 0m 04.40s: Reg check: Parse string: ( 61:8260762964 )( 50:8260762964 )( 20:23 )( OV:9171 )( BV:9173 )( S:33ca7435110b0484ef52de351e9f0d6f
 0m 04.50s: Reg check: thread exit normal.
 0m 04.52s: Reg check: Option check status-NewWork
 0m 04.53s: Reg check: ( HD Decrypter:1:0 )-( DVD to DVD (Gold):1:0 )-( DVD to DVD:1:0 )-( DVD to Mobile:1:0 )-( Blu-ray to Blu-ray:1:0 )-( Blu-ray to Mobile:1:0 )-( File to Mobile:1:1 )-( Blu-ray to DVD:1:0 )-( DVD to Blu-ray:1:0 )-( File to DVD:1:1 )-( File to Blu-ray:1:0 )-( File Mover:1:0 )-( Blu-ray to 3D:1:0 )-( 2D to 3D:1:0 )-( Blu-ray Decrypt:1:0 )-( DVD Decrypt:1:0 )-
 0m 04.59s: Reg check: connect successful and result code is 1.
 0m 04.59s: Reg check: End check info.
 0m 04.61s: Export Blu-ray source information report : enabled
 0m 04.63s: Init process: Init GPU settings successful.
 0m 05.88s: Init preview: Begin init preview play engine.
 0m 05.89s: Init preview: Begin init preview play engine(Internal).
 0m 07.60s: Init preview: Init internal engine successful.
 0m 08.95s: Burn engine: start init.
 0m 08.99s: Burn engine: set log folder.
 0m 09.00s: DVD: init read settings.
 0m 09.00s: DVD: init write settings.
 0m 09.22s: BD: init read settings.
 0m 09.23s: BD: init write settings.
 0m 09.24s: bd set region A
 0m 09.26s: Burn engine: config engine type-0 begin.
 0m 09.26s: Burn engine: config engine type-0 end.
 0m 09.26s: Burn engine: writer count 1.
 0m 09.26s: Burn engine: 0- D:\ [NECVMWar VMware SATA CD01 1.00 (Scsi)].
 0m 09.26s: Burn engine: end init.
 0m 11.53s: Init process: Init setting page successful.
 0m 11.65s: QtLog Mode = false 
 0m 11.65s: Show ProductsInfo Dlg 2 
 0m 22.02s: Show UI Step 2 
 0m 23.02s: Show UI Step 3 
 0m 23.02s: Start show MainUI.
 0m 23.09s: UI manager: switch to Copy mode.
 0m 25.45s: Init process: init main ui successful.
 0m 25.77s: Init process: show main ui successful.
 0m 25.77s: DriveX msg: Init driveX D with I/O mode: 0
 0m 27.51s: opening drive D
 0m 27.57s: opened i/o
 0m 27.59s: Source manager:open source flag:1,1,1,1
 0m 27.60s: Source manager:open source flag:1,1,1,1
 2m 34.73s: Source manager: select video files for open.
 2m 34.73s: Source manager:open source flag:1,1,1,1
 2m 37.48s: UI manager: switch to Convert mode.
 2m 50.74s: Source manager: select video files for open.
 2m 50.75s: Source manager: add source id 0.
 2m 50.84s: info, try to open file C:/Users/gosse_000/Downloads/X-Men (2000).m4v
 2m 51.05s: warning: audio info: index 2, codec_id 86019, channels 6, bitrate 448000, sample_rate 48000, format 8, bit_per_sample 16, frame_size 0 
 2m 51.06s: info: open successed, iformat = QuickTime / MOV
 2m 51.97s: Source manager: open successful.
 2m 52.94s: Work manager: create convert work 0 with source 0 and uiinfo 0.
 2m 52.95s: ========WorkAttr::SetSource=======
 2m 52.95s: Source Video Size Original : 1920 x 1080 
 2m 52.96s: Source Video Size Display : 1920 x 1080 
 2m 52.96s: Source Video FPS : 24000 / 1001 
 2m 52.96s: Source Video Bitrate : 1200 
 2m 52.97s: Source Audio Bitrate : 447697 
 2m 52.97s: Source Audio Channels : 6 
 2m 52.98s: Source Audio Volume : 100 
 2m 52.98s: Work Profile : MP4 
 2m 53.51s: Source manager:open source flag:1,1,1,1
 8m 53.00s: Work manager: create convert work 1 with source 0 and uiinfo 0.
 8m 53.00s: ========WorkAttr::SetSource=======
 8m 53.01s: Source Video Size Original : 1920 x 1080 
 8m 53.01s: Source Video Size Display : 1920 x 1080 
 8m 53.02s: Source Video FPS : 24000 / 1001 
 8m 53.02s: Source Video Bitrate : 1200 
 8m 53.03s: Source Audio Bitrate : 447697 
 8m 53.03s: Source Audio Channels : 6 
 8m 53.04s: Source Audio Volume : 100 
 8m 53.04s: Work Profile : MP4.H265 
10m 15.77s: UILog:OnMsgToolbar_Start
10m 15.79s: UILog:Msg Start : ready start
10m 15.79s: UILog:Msg Start : start test run work
10m 15.80s: UILog:right button to null, work falg = -1
10m 15.82s: UILog:Msg Start : run work
10m 15.83s: UILog:Run current Work.
10m 15.83s: UILog:Begin work copy or converter.
10m 15.83s: Start check Video Converter register status.
10m 15.84s: End check Video Converter register status: Enable
10m 15.84s: UILog:start running at thread.
10m 15.85s: UILog:return flag at start running at thread ok.
10m 15.87s: OPList at BD Converter : (0.2),(1.1)
10m 15.88s: Video Converter check watermark flag: 0
10m 16.89s: ------------------  convert work begin(1/1)  ------------------ 
10m 16.90s: start process(1/1)

------ process working ------
 0m 00.15s: info, try to open file C:/Users/gosse_000/Downloads/X-Men (2000).m4v
 0m 00.34s: warning: audio info: index 2, codec_id 86019, channels 6, bitrate 448000, sample_rate 48000, format 8, bit_per_sample 16, frame_size 0 
 0m 00.35s: info: open successed, iformat = QuickTime / MOV
 0m 00.35s: info: create config(videoconvert)
 0m 00.36s: info: crop value after clone: left = 0 right= 0 top=0 bottom=0 enable=0 mode=0
 0m 00.37s: info: use profile(MP4.H265)
 0m 00.37s: info: file (.m4v)
 0m 00.38s: info: 3D working_mode(disable), 3D format(sbs_lef_right) 
10m 18.47s: UILog:MsgWork:WorkStatus_Start
 0m 00.39s: info: stream input@ Video(1)[codec(h264) size(1920*1080) fps(24000/1001) interlace(1) duration(6260)sec opcode(compress)]
 0m 00.40s: info: perset file config OK ! 
 0m 00.40s: info: set output video frame_rate(24000/1001)
 0m 00.42s: info: recommand= 0, Shrink support= 0, enable= 0, cuda_cap= 0 , cpu_count= 8
 0m 00.42s: info: stream output Video(1)[codec(hevc) size(1920*1080) fps(24000/1001) interlace(1) bitrate(18644) duration(6260)sec]
 0m 00.43s: info: stream input@ Audio(2)[codec(aac) channels(6) sample(48000) bitrate(447697) bitdepth(16) opcode(copy)]
 0m 00.44s: info: stream output Audio(2)[codec(aac) channels(6) sample(48000) bitrate(447697) bitdepth(16) opcode(copy)]
 0m 00.44s: info: SubMode(Render) -- Display Only forced Subtitle(false) 
 0m 00.45s: info: enable multi-thread software decoder, thread count = 8
10m 18.54s: UILog:MsgWork:WorkStatus_Start
 0m 00.51s: info: h264_encode: encode param profile(1) level(40) bitrate(18644) crf(-1)
683m 22.48s: UILog:OnMsgToolbar_Pause
1012m 45.95s: UILog:OnMsgToolbar_Continue
1016m 51.19s: UILog:OnMsgToolbar_Pause
1023m 29.63s: UILog:OnMsgToolbar_Continue
1025m 32.38s: UILog:OnMsgToolbar_Pause
1068m 21.07s: UILog:OnMsgToolbar_Continue
1096m 37.97s: UILog:OnMsgToolbar_Pause
1097m 27.85s: UILog:OnMsgToolbar_Continue
1099m 42.24s: UILog:OnMsgToolbar_Pause
1119m 51.49s: UILog:OnMsgToolbar_Continue
1352m 24.06s: UILog:OnMsgToolbar_Pause
1358m 39.67s: UILog:OnMsgToolbar_Continue
1371m 57.75s: UILog:OnMsgToolbar_Pause
1428m 50.20s: UILog:OnMsgToolbar_Continue
1561m 08.85s: UILog:OnMsgToolbar_Pause
1565m 19.83s: UILog:OnMsgToolbar_Continue
1662m 16.44s: UILog:OnMsgToolbar_Pause
1721m 36.26s: UILog:OnMsgToolbar_Continue
2450m 53.00s: UILog:OnMsgToolbar_Pause
2655m 28.27s: UILog:OnMsgToolbar_Continue
3085m 11.12s: UILog:OnMsgToolbar_Pause
3102m 47.63s: UILog:OnMsgToolbar_Continue
3514m 24.06s: info: enable multi-thread software decoder, thread count = 8
3514m 24.13s: info: h264_encode: encode param profile(1) level(40) bitrate(18644) crf(-1)
3876m 03.02s: UILog:OnMsgToolbar_Pause
3911m 31.78s: UILog:OnMsgToolbar_Continue
4592m 49.01s: UILog:OnMsgToolbar_Pause
4631m 29.92s: UILog:OnMsgToolbar_Continue
6087m 45.12s: UILog:OnMsgToolbar_Pause
6107m 20.53s: UILog:OnMsgToolbar_Continue
6116m 24.26s: UILog:OnMsgToolbar_Pause
6119m 42.98s: UILog:OnMsgToolbar_Continue
6355m 00.78s: 
------ process exit ------
6365m 18.97s: ------------------  convert work finished  ------------------
6365m 20.10s: UILog:MsgWork:current work finish : 3
6365m 20.15s: UILog:Run Work to end.
6664m 33.17s: Source manager:open source flag:1,1,1,1
6665m 39.80s: Exit process: stop running.
6665m 39.83s: Exit process: preview pfn_releaseplayer end
6665m 39.84s: Exit process: preview pfn_deinit end
6665m 39.86s: Exit process: preview FreeLibrary end

                    Comment

                      #11
                      The log indicates you used h264 encoding. ??

                      3514m 24.13s: info: h264_encode: encode param profile(1) level(40) bitrate(18644) crf(-1)
                      Supplying DVDFab Logs in the Forum ...........................User Manual PDF for DVDFab v11................................ Guide: Using Images in Posts
                      Supplying DMS Logs to Developers................................Enlarger AI FAQ.....

                      Comment

                        #12
                        I noticed that has well. The output file is reported has h265 by MediaInfo.
                        The encoding parameters where h265 too in DVDFab. I suspect an erroneous log line here.

                        Comment

                          #13
                          Originally posted by spaceharfang View Post
                          I finished encoding my large video with 9.1.7.3 using h265 2 pass.
                          It did manage to encode the full file without crashing.
                          But instead on giving the requested 18644 kb/s, the end result was 30.1 mb/s. Almost the same as the original h264 file.
                          This seems to be related to the requested bitrate.
                          I have no problem encoding a file at 10mbps, yet 14 mpbs is causing the behavior.

                          Note to moderators: Should a new thread be started to address that issue on its own?

                          Comment

                            #14
                            12.9 mbps is causing the behavior.

                            Comment

                              #15
                              Hi,

                              Thanks for your more info, we are checking the issue. And it does not need the higher video bitrate when converting to h265.

                              Wilson
                              Please post your logs the default location is:
                              For DVDFab 13: C:\Users\User Name\My Documents\DVDFab\DVDFab13\Log
                              For StreamFab: C:\Users\User Name\My Documents\DVDFab\StreamFab\log
                              Please use attachment button and attach your most recent, Internal log and post right here.
                              If it's the burning issue, please also attach burn log.

                              Thanks!

                              Comment

                              Previous 1 2 template Next
                              Working...
                              X