Large part of rustc still missing backtrace line number with debug = true

in the backtrace, there are line numbers at beginning, then stopped at 11, but reappeared at 82

It happens with both 1.50.0, and master branch.

 10:        0x1001e622e - <alloc::boxed::Box as core::ops::function::Fn>::call::h19ba60934cab04ed
                               at /Users/david/rust/library/alloc/src/boxed.rs:1560:9
  11:        0x1001e622e - rustc_driver::report_ice::h6d0ecd97991f59ef
                               at /Users/david/rust/compiler/rustc_driver/src/lib.rs:1191:5
  12:        0x109bbd39e - std::panicking::rust_panic_with_hook::h0435df260ec30780
                               at /Users/david/rust/library/std/src/panicking.rs:595:17
  13:        0x1045d76dd - std::panicking::begin_panic::{{closure}}::hb3109550b5826a6b
  14:        0x1045d7668 - std::sys_common::backtrace::__rust_end_short_backtrace::h99b11b7f9ff20d54
  15:        0x1045d82be - std::panicking::begin_panic::h36ba9f981c6887ce
  16:        0x1045db9d0 - rustc_errors::HandlerInner::emit_diagnostic::hf5eb3d0c9c903465
  17:        0x1045db04d - rustc_errors::Handler::emit_diagnostic::h48961d9e006bab92
  18:        0x1045b726b - rustc_errors::diagnostic_builder::DiagnosticBuilder::emit::hde3ea307b55cd97a
  19:        0x1037862d2 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h551827723b34b139
  20:        0x1042a24e9 - <alloc::boxed::Box as core::ops::function::FnOnce>::call_once::hc332b41b3bf13897
  21:        0x10426cfec - rustc_middle::lint::struct_lint_level::struct_lint_level_impl::ha01fd16f48d384b9
  22:        0x1037852cb - rustc_middle::lint::struct_lint_level::h14277d8478c55ea6
  23:        0x103468aee - rustc_middle::ty::context::TyCtxt::struct_span_lint_hir::ha4c01f4a8292816a
...
 81:        0x102f90b23 - rustc_query_system::query::plumbing::get_query::hd74468c054aad160
  82:        0x1000e68a0 - rustc_middle::ty::query::TyCtxtAt::analysis::hd383a5a87748313f
                               at /Users/david/rust/compiler/rustc_middle/src/ty/query/mod.rs:205:17
  83:        0x1000e68a0 - rustc_middle::ty::query::::analysis::h33211601c41bd8a0
                               at /Users/david/rust/compiler/rustc_middle/src/ty/query/mod.rs:186:17