Black Pits -- What are they and how to remove? [Deep Sky] Processing techniques · Jeff Ridder · ... · 19 · 481 · 1

jpridder86 2.41
...
Captured some Horsehead and Flame in narrowband the other night. Each of my integrated frames -- Ha, OIII, and SII have black pits everywhere. And they're correlated across the three filters. Same pits in each image, so it's not a particular filter. They also exist in the raw subs, but much fainter (obviously). Calibrated with a new set of (50 each) darks, flats, and flat-darks. These pits aren't in the calibration files. I also collected with these filters on a previous night on another target -- no pits.

1) What are they? Since they don't show up in my flats, I'm guessing not dust. It was a very cold night, possibly frost on the sensor window?

2) Anything I can do to remove them? I use PixInsight. Tried various tricks with Cosmetic Correction on the calibrated subs -- no change.

This is the SII integrated image. The black pits are the same in the other two and in the same locations.
Horsehead_SII_Black_spots.jpg
Edited ...
Like
ODRedwine 1.51
...
·  2 likes
Frost on the sensor window should have a more diffuse edge, the edge of these spots seems too sharp.  I'm guessing frost on the actual sensor surface itself, but that is just a guess.

Try regenerating the desiccant.
Like
honeycakehorse 1.91
...
·  2 likes
Hey Jeff,
i had smaller black dots across my image and some time ago.
The integration process was my problem, when i did it manually step by step. I can't explain the exact reason but it resolved when i switched to the weighted batch preprocessing tool...
If i can remember correctly, it had something to do with the calibration of darks.
Maybe just try a different integration method and compare the results before changing setup routines.
clear skies,
honeycakehorse
Like
jpridder86 2.41
...
Aaaargh! Just found another night's worth of data with the same affliction. Black pits that correlate across filters. BUT, these pits don't correlate with the pits from a different night. Homing in on frost being the issue.

@Honeycakehorse  -- thanks for the suggestion. I'll give that a try.
Like
honeycakehorse 1.91
...
·  1 like
hmm, do you use dew heater?
​​​​​​
(nevertheless i would check out an alternative integration ;))
Like
jpridder86 2.41
...
Honeycakehorse:
hmm, do you use dew heater?
​​​​​​
(nevertheless i would check out an alternative integration ;))

The ASI1600MM-Pro has desiccant pellets inside the sensor window. I've refreshed them (per above suggestion) and ASI claims you don't need a dew heater. I'm thinking they might be wrong.
Like
honeycakehorse 1.91
...
This might be the case but it doesn't protect the telescope itself from dew, right?
Like
jpridder86 2.41
...
Honeycakehorse:
This might be the case but it doesn't protect the telescope itself from dew, right?

Should have mentioned -- I have dew straps on the OTA.
Like
ODRedwine 1.51
...
·  1 like
Dew on the OTA usually just results in low contrast.
Like
ODRedwine 1.51
...
·  1 like
BTW  pixel rejection such as Winsorized Sigma Clipping only rejects  data that is an outlier for a particular pixel stack.  If this artifact is in all the subs it will not be rejected by the clipping function during integration.

You might try the Canon banding script.
Like
jpridder86 2.41
...
David Redwine:
BTW  pixel rejection such as Winsorized Sigma Clipping only rejects  data that is an outlier for a particular pixel stack.  If this artifact is in all the subs it will not be rejected by the clipping function during integration.

You might try the Canon banding script.

Thanks for the tip. Was unaware of this script. Tried it, but no improvement. I think I'm down to paint by number or re-shoot.
Like
skybob727 6.08
...
Just a thought,

I think the bigger picture hear is finding where and why the spots are there too begin with, not to just process them out. I think the spots are to small to be anything other then on the sensor or the window, and if it’s from dew and has dried, the sensor or window may need to be cleaned, if that’s possible.
Like
jpridder86 2.41
...
Bob Lockwood:
Just a thought,

I think the bigger picture hear is finding where and why the spots are there too begin with, not to just process them out. I think the spots are to small to be anything other then on the sensor or the window, and if it’s from dew and has dried, the sensor or window may need to be cleaned, if that’s possible.

Thanks, and I agree. Given that they show up on subs from some nights and not on others, I think I've determined that it is frost. The fact that the spots are in the same location across multiple filters on the same night, but then in a different location on another night, seems to support the frost hypothesis. I've cleaned both the sensor and the window, and refreshed the desiccant inside the chamber. Hoping that takes care of the problem. Just in case it doesn't, I've ordered the ZWO dew heater which, like all other astronomy gear, is on backorder until Spring. ;)
Like
HegAstro 11.91
...
·  2 likes
Jeff -

Assuming it is dew/frost, it may not be inside the sensor chamber (which is sealed) but on the outer window surface. I had an issue with this same camera of dew. I initially thought it was on the sensor and microwaved the desiccant tablets. This made no difference. The solution was to stick a resistance heater on the outer surface of the camera where it mates with the filter wheel - this one:

https://astronomy-imaging-camera.com/product/anti-dew-heater

That surface is obviously just above a very cold sensor and so does get cold. It is heated by waste heat from the TEC, but since the TEC does not generate much heat in winter, that heating can be ineffective. ZWO knows this is an issue, and newer cameras come with this pre-installed. Not the ZWO ASI 1600MM Pro though. So if your desiccant tablet refresh doesn't work, install this heater.
Edited ...
Like
jpridder86 2.41
...
Jeff -

Assuming it is dew/frost, it may not be inside the sensor chamber (which is sealed) but on the outer window surface. I had an issue with this same camera of dew. I initially thought it was on the sensor and microwaved the desiccant tablets. This made no difference. The solution was to stick a resistance heater on the outer surface of the camera where it mates with the filter wheel - this one:

https://astronomy-imaging-camera.com/product/anti-dew-heater

That surface is obviously just above a very cold sensor and so does get cold. It is heated by waste heat from the TEC, but since the TEC does not generate much heat in winter, that heating can be ineffective. ZWO knows this is an issue, and newer cameras come with this pre-installed. Not the ZWO ASI 1600MM Pro though. So if your desiccant tablet refresh doesn't work, install this heater.

Thanks, but I beat you to it! ;) Found that and ordered it but, like all other astro gear, it is on back order. So, hoping the desiccant refresh gets the job done. Will find out later this week (I hope).
Like
XCalRocketMan 3.71
...
·  2 likes
Jeff -

Assuming it is dew/frost, it may not be inside the sensor chamber (which is sealed) but on the outer window surface. I had an issue with this same camera of dew. I initially thought it was on the sensor and microwaved the desiccant tablets. This made no difference. The solution was to stick a resistance heater on the outer surface of the camera where it mates with the filter wheel - this one:

https://astronomy-imaging-camera.com/product/anti-dew-heater

That surface is obviously just above a very cold sensor and so does get cold. It is heated by waste heat from the TEC, but since the TEC does not generate much heat in winter, that heating can be ineffective. ZWO knows this is an issue, and newer cameras come with this pre-installed. Not the ZWO ASI 1600MM Pro though. So if your desiccant tablet refresh doesn't work, install this heater.

I've added this dew heater to my 1600 and my frost/dew issues have gone away.  Recommended addition to the ASI1600mm.
Like
Paolo_italy 0.00
...
·  2 likes
I remember a IRIS tutorial to extract the flat-field from lights images.
You can give it a try to avoid trash lot of integration time, or find a way to replicate the procedure with PixInsight

http://www.astrosurf.com/buil/iris/tutorial2/doc91_us.htm
Like
Alan_Brunelle
...
·  1 like
Sounds like you have identified your problem.

in the future, if you have your camera dismounted, it is not too difficult to just plug it in and cool it down to your operating temperature for a while. If there is frosting on the protective window or sensor, you should be able to see it under a bright light.

Also frost will often nucleate on dust or dirt particles, either on the sensor cover glass or the window. So cleaning can still help.
Like
AwesomeAstro 2.39
...
Although I've never had frost on the imaging sensor (only the corrector plate, which looks nothing like this because the problem is very, very close to the focal point to be this clear on your image), it seems that the general consensus here is that this is the issue.

While you're waiting for your new equipment, you can test a few other things without needing to image. First off, did you take your flats on a different day than the imaging session, or did you take them right afterwards? If I take flats on a different day, dust in my train definitely moves, making those flats fail to remove the dust motes. If you took them the same night, then they should at least slightly help with this dust or frost. If you took them later on, neither of these problems would be calibrated out with those flats.

It's also worth noting that even though very obvious in a final stack, the presence of these motes in the flats isn't always obvious, because they hardly have the same amount of integration time. You should debayer (if applicable) your master flat, use backgroundneutralization, and then hit it with automatic background extractor. Now use the screentransferfunction, and it will reveal, very aggressively, any pits or motes in your master flat. This can help with the investigation too, since you won't always see these imperfections in the master flat even if they're there. You certainly can't pick them out in individual flat frames, at least usually.
Like
 
Register or login to create to post a reply.